Nov 06 21:08:11 devstack cinder-volume[76197]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:08:11 devstack cinder-volume[76197]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:08:11 devstack cinder-volume[76197]: we strongly recommend against using it for new projects. Nov 06 21:08:11 devstack cinder-volume[76197]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:08:11 devstack cinder-volume[76197]: framework. For more detail see Nov 06 21:08:11 devstack cinder-volume[76197]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:08:11 devstack cinder-volume[76197]: import eventlet # noqa Nov 06 21:08:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:08:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:08:14 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:08:15 devstack cinder-volume[76197]: INFO dbcounter [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Registered counter for database cinder Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG oslo_db.sqlalchemy.engines [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writer thread running {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:08:15 devstack cinder-volume[76197]: INFO cinder.rpc [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:08:15 devstack cinder-volume[76197]: INFO cinder.rpc [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG oslo_db.sqlalchemy.engines [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:08:15 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Determined volume DB was empty at startup. Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG cinder.volume.manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76197) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:08:15 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:08:15 devstack cinder-volume[76197]: WARNING stevedore.named [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:08:15 devstack cinder-volume[76197]: WARNING castellan.key_manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:08:15 devstack cinder-volume[76197]: WARNING cinder.keymgr.conf_key_mgr [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG cinder.volume.drivers.lvm [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76197) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 21:08:15 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_concurrency.processutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] CMD "cinder-rtstool verify" returned: 0 in 0.415s {{(pid=76197) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_db.sqlalchemy.engines [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:08:16 devstack cinder-volume[76197]: INFO cinder.rpc [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 21:08:16 devstack cinder-volume[76197]: INFO cinder.rpc [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 21:08:16 devstack cinder-volume[76197]: WARNING stevedore.named [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:08:16 devstack cinder-volume[76197]: WARNING castellan.key_manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:08:16 devstack cinder-volume[76197]: INFO cinder.volume.manager [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_db.sqlalchemy.engines [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:08:16 devstack cinder-volume[76197]: INFO oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Starting 1 workers Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Started child 76352 {{(pid=76197) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Full set of CONF: {{(pid=76197) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] ******************************************************************************** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Configuration options gathered from: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] ================================================================================ {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] allow_availability_zone_fallback = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] allow_compression_on_image_upload = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] allowed_direct_url_schemes = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] api_rate_limit = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] auth_strategy = keystone {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] az_cache_duration = 3600 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_availability_zone = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_host = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_stats_polling_interval = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backup_api_class = cinder.backup.api.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backup_name_template = backup-%s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backup_use_same_host = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backup_use_temp_snapshot = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] chap_password = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] chap_username = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_internal_tenant_project_id = 946a51f8d5ce42c1af195a66c61d4c6e {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_internal_tenant_user_id = 77d4ef6c92f445d387cb23cef10fa029 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cloned_volume_same_az = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cluster = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] compression_format = gzip {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] compute_api_class = cinder.compute.nova.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] config_dir = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] config_source = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] control_exchange = openstack {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] debug = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] default_availability_zone = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76352]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] default_group_type = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] default_volume_type = lvmdriver-1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] disk_geometry = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_client_cert = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_client_cert_key = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_data_namespace = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_ssl_cert_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_ssl_cert_verify = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] driver_use_ssl = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] enable_force_upload = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] enable_new_services = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] enable_unsupported_driver = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] enforce_multipath_for_image_xfer = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] filter_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_api_insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_api_ssl_compression = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_ca_certificates_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_catalog_info = image:glance:publicURL {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_num_retries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance_request_timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] goodness_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] graceful_shutdown_timeout = 5 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] group_api_class = cinder.group.api.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] host = devstack {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_compress_on_upload = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_conversion_address_space_limit = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_conversion_cpu_limit = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_conversion_disable = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_introspection_address_space_limit = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_introspection_cpu_limit = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_upload_use_cinder_backend = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_upload_use_internal_tenant = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_volume_cache_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_volume_cache_max_count = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] image_volume_cache_max_size_gb = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] init_host_max_objects_retrieval = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] instance_format = [instance: %(uuid)s] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iscsi_target_flags = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iscsi_write_cache = on {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iser_helper = tgtadm {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iser_ip_address = 192.168.122.140 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iser_port = 3260 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_color = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_config_append = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_dir = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_options = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_rotate_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_rotate_interval_type = days {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] log_rotation_type = none {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] max_age = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] max_logfile_count = 30 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] max_logfile_size_mb = 200 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] max_over_subscription_ratio = 20.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] message_reap_interval = 86400 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] message_ttl = 2592000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] migration_create_volume_timeout_secs = 300 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] monkey_patch = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] monkey_patch_modules = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] my_ip = 192.168.122.140 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] no_snapshot_gb_quota = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] num_iser_scan_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] num_shell_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] num_volume_device_scan_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] nvmeof_conn_info_version = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] nvmet_ns_id = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] nvmet_port_id = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_max_limit = 1000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_ext_list = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_listen_port = 8776 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_use_ssl = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] osapi_volume_workers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] per_volume_size_limit = -1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] periodic_fuzzy_delay = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] periodic_interval = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] public_endpoint = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] publish_errors = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_backup_gigabytes = 1000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_backups = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_gigabytes = 1000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_groups = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_snapshots = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] quota_volumes = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] rate_limit_burst = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] rate_limit_except_level = CRITICAL {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] rate_limit_interval = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] reinit_driver_count = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] replication_device = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] report_discard_supported = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] report_interval = 120 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] reservation_clean_interval = 86400 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] reservation_expire = 86400 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] reserved_image_namespaces = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] reserved_percentage = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] rpc_response_timeout = 120 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] run_external_periodic_tasks = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] scst_target_driver = iscsi {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] scst_target_iqn_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_down_time = 720 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] shell_completion = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] snapshot_name_template = snapshot-%s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] snapshot_same_host = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] split_loggers = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] state_path = /opt/stack/data/cinder {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] storage_availability_zone = nova {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] storage_protocol = iSCSI {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] syslog_log_facility = LOG_USER {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_helper = lioadm {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_ip_address = 192.168.122.140 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_port = 3260 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_protocol = iscsi {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] target_secondary_ip_addresses = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] trace_flags = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] transport_url = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] until_refresh = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_chap_auth = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_default_quota_class = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_journal = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_json = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_multipath_for_image_xfer = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_stderr = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] use_syslog = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] verify_glance_signatures = enabled {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_api_class = cinder.volume.api.API {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_backend_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_clear = zero {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_clear_ionice = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_clear_size = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_copy_bps_limit = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_dd_blocksize = 1M {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_name_template = volume-%s {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_service_inithost_offload = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volume_usage_audit_period = month {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] zoning_mode = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_concurrency.disable_process_locking = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.auth_section = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.auth_type = password {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.auth_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.cache = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.include_service_catalog = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.interface = public {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_password = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcache_username = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.region_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.service_type = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.backend = dogpile.cache.null {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.backend_argument = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.backend_expiration_time = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.config_prefix = cache.oslo {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.debug_cache_backend = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.enable_retry_client = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.enable_socket_keepalive = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.expiration_time = 600 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.hashclient_retry_attempts = 2 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_dead_retry = 300 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_pool_maxsize = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_sasl_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.password = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.proxies = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.redis_db = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.redis_server = localhost:6379 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.retry_attempts = 2 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.retry_delay = 0.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.socket_keepalive_count = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.socket_keepalive_idle = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.socket_keepalive_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.socket_timeout = 1.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.tls_allowed_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.tls_cafile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.tls_certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.tls_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.tls_keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cache.username = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] coordination.backend_url = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.asyncio_connection = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.asyncio_slave_connection = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.backend = sqlalchemy {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.connection = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.connection_debug = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.connection_parameters = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.connection_recycle_time = 3600 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.connection_trace = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.db_inc_retry_interval = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.db_max_retries = 20 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.db_max_retry_interval = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.db_retry_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.max_overflow = 50 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.max_pool_size = 5 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.max_retries = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.mysql_wsrep_sync_wait = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.pool_timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.retry_interval = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.slave_connection = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.sqlite_synchronous = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.synchronous_reader = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] database.use_db_reconnect = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_tracing.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.connection_string = messaging:// {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.es_doc_type = notification {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.es_scroll_size = 10000 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.es_scroll_time = 2m {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.filter_error_trace = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.hmac_keys = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.sentinel_service_name = mymaster {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.socket_timeout = 0.1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.trace_requests = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler.trace_sqlalchemy = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler_jaeger.process_tags = {} {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler_jaeger.service_name_prefix = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] profiler_otlp.service_name_prefix = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.enforce_new_defaults = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.policy_default_rule = default {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.policy_file = policy.yaml {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.group = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.helper_command = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] privsep_osbrick.user = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.group = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.helper_command = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] cinder_sys_admin.user = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.auth_section = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.auth_type = password {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.cafile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.collect_timing = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.send_service_user_token = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.split_loggers = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.tls_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] service_user.tls_min_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.auth_section = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.auth_type = password {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.collect_timing = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.region_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.split_loggers = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.tls_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] glance.tls_min_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.backend_availability_zone = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.chap_password = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.chap_username = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.disk_geometry = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_client_cert = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_client_cert_key = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_data_namespace = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.driver_use_ssl = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.extra_capabilities = {} {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.filter_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.goodness_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iscsi_target_flags = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iscsi_write_cache = on {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iser_helper = tgtadm {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iser_port = 3260 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.lvm_share_target = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.lvm_type = auto {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.num_shell_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.replication_device = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.report_discard_supported = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.reserved_percentage = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_helper = tgtadm {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_port = 3260 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_protocol = iscsi {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.trace_flags = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.unique_fqdn_network = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.use_chap_auth = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_backend_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_clear = zero {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_clear_ionice = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_clear_size = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_reports.file_event_handler = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_reports.log_dir = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.backend_host = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.chap_password = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.chap_username = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.disk_geometry = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_client_cert = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.extra_capabilities = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.filter_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.goodness_function = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iser_helper = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iser_ip_address = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iser_port = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.lvm_share_target = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.lvm_type = auto {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.num_shell_tries = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.replication_device = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.report_discard_supported = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.reserved_percentage = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.scst_target_driver = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.storage_protocol = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_helper = lioadm {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_ip_address = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_port = 3260 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.trace_flags = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.use_chap_auth = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_clear = zero {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_clear_size = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] lvmdriver-1.volumes_dir = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_notifications.driver = [] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_notifications.retry = -1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] key_manager.fixed_key = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.barbican_api_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.barbican_endpoint = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.barbican_endpoint_type = public {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.barbican_region_name = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.cafile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.collect_timing = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.number_of_retries = 60 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.retry_delay = 1 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.send_service_user_token = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.split_loggers = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.tls_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.tls_min_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.verify_ssl = True {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican.verify_ssl_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.auth_section = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.auth_type = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.cafile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.certfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.collect_timing = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.insecure = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.keyfile = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.split_loggers = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.timeout = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.tls_ciphers = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] barbican_service_user.tls_min_version = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.approle_role_id = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.approle_secret_id = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.auth_method = approle {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.auth_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.kv_mountpoint = secret {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.kv_path = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.kv_version = 2 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.namespace = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.root_token_id = **** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.ssl_ca_crt_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.timeout = 60.0 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.token_file = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.token_role = None {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.use_ssl = False {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:08:16 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] ******************************************************************************** {{(pid=76197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:16 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:16 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 21:08:16 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:17 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:17 devstack sudo[76484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:17 devstack sudo[76484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:17 devstack sudo[76484]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.275s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:08:17 devstack cinder-volume[76352]: INFO cinder.brick.local_dev.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:17 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:17 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:17 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG cinder.brick.local_dev.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76352) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 21:08:17 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:17 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:17 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:18 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:18 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:18 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:18 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:18 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 21:08:18 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:18 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:18 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:18 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:18 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:19 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.366s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:19 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:19 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:19 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:19 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:19 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:19 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:19 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:19 devstack sudo[77148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:19 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:20 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:20 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:20 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:20 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:20 devstack cinder-volume[76352]: INFO cinder.volume.drivers.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:20 devstack sudo[77162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:20 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:20 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:08:20 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:20 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:20 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:21 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:21 devstack sudo[77168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:21 devstack sudo[77168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:21 devstack sudo[77168]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:21 devstack sudo[77171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:21 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:21 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:21 devstack sudo[77174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:21 devstack sudo[77174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:21 devstack sudo[77174]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:21 devstack cinder-volume[76352]: INFO cinder.volume.driver [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG cinder.volume.driver [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76352) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writer thread running {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG cinder.db.api [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Building query based on filter {{(pid=76352) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:08:21 devstack cinder-volume[76352]: DEBUG cinder.image.image_utils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76352) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:08:22 devstack cinder-volume[76352]: INFO cinder.keymgr.migration [None req-82240c3e-6edf-419f-9f71-75934845d990 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:22 devstack sudo[77177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:22 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:22 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:22 devstack sudo[77182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:22 devstack sudo[77182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:22 devstack sudo[77182]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:22 devstack sudo[77186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:22 devstack sudo[77186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:22 devstack sudo[77186]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:22 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:22 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:22 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:23 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG cinder.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Notifying Schedulers of capabilities ... {{(pid=76352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:08:23 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Driver initialization completed successfully. Nov 06 21:08:23 devstack cinder-volume[76352]: INFO cinder.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Initiating service 2 cleanup Nov 06 21:08:23 devstack cinder-volume[76352]: INFO cinder.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Service 2 cleanup completed. Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG cinder.service [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Creating RPC server for service cinder-volume {{(pid=76352) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG cinder.service [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76352) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:08:23 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:23 devstack sudo[77194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:08:23 devstack sudo[77194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:23 devstack sudo[77194]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:23 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:23 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:23 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:23 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:23 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:08:23 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:24 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:24 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:24 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:08:24 devstack sudo[77207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:08:24 devstack sudo[77207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:08:24 devstack sudo[77207]: pam_unix(sudo:session): session closed for user root Nov 06 21:08:24 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:08:24 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-5c57d9d5-38aa-43e6-b142-67057bf653f9 None None] Driver post RPC initialization completed successfully. Nov 06 21:08:26 devstack cinder-volume[76197]: DEBUG dbcounter [-] [76197] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:08:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=3 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:08:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:09:03 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager._thread_info {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:09:03 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread count: 6 {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:09:03 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread info: [<_MainThread(MainThread, started 129455593980032)>, , , , , ] {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:10:03 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:03 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:10:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:03 devstack sudo[82280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:10:03 devstack sudo[82280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:03 devstack sudo[82280]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:03 devstack sudo[82284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:03 devstack sudo[82284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:04 devstack sudo[82284]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:04 devstack sudo[82303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:10:04 devstack sudo[82303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:04 devstack sudo[82303]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:04 devstack sudo[82328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:04 devstack sudo[82328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:04 devstack sudo[82328]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG cinder.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Notifying Schedulers of capabilities ... {{(pid=76352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager._thread_info {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread count: 6 {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:10:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread info: [<_MainThread(MainThread, started 129455593980032)>, , , , , ] {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:10:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:10:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:UPDATE=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:11:03 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:11:03 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:11:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:03 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:11:03 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:03 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:03 devstack sudo[84023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:03 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:04 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:04 devstack sudo[84047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:11:04 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:04 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:04 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:04 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:04 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG cinder.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Notifying Schedulers of capabilities ... {{(pid=76352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager._thread_info {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread count: 6 {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:11:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread info: [<_MainThread(MainThread, started 129455593980032)>, , , , , ] {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:12:03 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:12:03 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Updating volume stats {{(pid=76352) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:12:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:03 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:12:03 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:03 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:03 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:03 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:04 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:04 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:12:04 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:04 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:04 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:04 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:04 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG cinder.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Notifying Schedulers of capabilities ... {{(pid=76352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG oslo_service.periodic_task [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] Running periodic task VolumeManager._thread_info {{(pid=76352) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread count: 6 {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:12:04 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-030d55bc-4828-43c5-981e-2836bd12962b None None] thread info: [<_MainThread(MainThread, started 129455593980032)>, , , , , ] {{(pid=76352) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:12:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:12:34 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:UPDATE=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:12:42 devstack cinder-volume[76197]: INFO oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Caught SIGTERM, stopping children Nov 06 21:12:42 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Acquiring lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:12:42 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Acquired lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:12:42 devstack cinder-volume[76197]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Releasing lock "singleton_lock" {{(pid=76197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:12:42 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Stop services. {{(pid=76197) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:12:42 devstack cinder-volume[76197]: DEBUG oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Killing children. {{(pid=76197) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:12:42 devstack cinder-volume[76197]: INFO oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Waiting on 1 children to exit Nov 06 21:12:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Acquiring lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:12:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Acquired lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:12:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Releasing lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:12:43 devstack cinder-volume[76352]: WARNING amqp [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:12:43 devstack cinder-volume[76352]: WARNING amqp [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:12:43 devstack cinder-volume[76197]: INFO oslo_service.backend._eventlet.service [None req-8a0f2e8b-b84a-4591-8070-eb8e4f680e48 None None] Child 76352 exited with status 0 Nov 06 21:12:43 devstack cinder-volume[86393]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:12:43 devstack cinder-volume[86393]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:12:43 devstack cinder-volume[86393]: we strongly recommend against using it for new projects. Nov 06 21:12:43 devstack cinder-volume[86393]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:12:43 devstack cinder-volume[86393]: framework. For more detail see Nov 06 21:12:43 devstack cinder-volume[86393]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:12:43 devstack cinder-volume[86393]: import eventlet # noqa Nov 06 21:12:45 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:12:45 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:12:45 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:12:46 devstack cinder-volume[86393]: INFO dbcounter [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Registered counter for database cinder Nov 06 21:12:46 devstack cinder-volume[86393]: DEBUG oslo_db.sqlalchemy.engines [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:12:46 devstack cinder-volume[86393]: DEBUG dbcounter [-] [86393] Writer thread running {{(pid=86393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:12:46 devstack cinder-volume[86393]: INFO cinder.rpc [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:12:46 devstack cinder-volume[86393]: INFO cinder.rpc [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_db.sqlalchemy.engines [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:12:47 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Determined volume DB was empty at startup. Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG cinder.volume.manager [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86393) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:12:47 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:12:47 devstack cinder-volume[86393]: WARNING stevedore.named [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:12:47 devstack cinder-volume[86393]: WARNING castellan.key_manager [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:12:47 devstack cinder-volume[86393]: WARNING cinder.keymgr.conf_key_mgr [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:12:47 devstack cinder-volume[86393]: INFO cinder.volume.manager [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_db.sqlalchemy.engines [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:12:47 devstack cinder-volume[86393]: INFO oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Starting 1 workers Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Started child 86612 {{(pid=86393) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Full set of CONF: {{(pid=86393) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] ******************************************************************************** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Configuration options gathered from: {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] ================================================================================ {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] allow_availability_zone_fallback = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] allow_compression_on_image_upload = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] allowed_direct_url_schemes = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] api_rate_limit = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] auth_strategy = keystone {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_availability_zone = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_host = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_stats_polling_interval = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86612]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backup_api_class = cinder.backup.api.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backup_name_template = backup-%s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backup_use_same_host = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backup_use_temp_snapshot = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] chap_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] chap_username = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_internal_tenant_project_id = 946a51f8d5ce42c1af195a66c61d4c6e {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_internal_tenant_user_id = 77d4ef6c92f445d387cb23cef10fa029 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cluster = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] compression_format = gzip {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] config_dir = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] config_source = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] control_exchange = openstack {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] debug = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] default_availability_zone = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] default_group_type = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] default_volume_type = QuobyteHD {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] disk_geometry = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_client_cert = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_client_cert_key = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_data_namespace = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_ssl_cert_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_ssl_cert_verify = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] driver_use_ssl = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] enable_new_services = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] enable_unsupported_driver = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] enforce_multipath_for_image_xfer = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] filter_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_api_insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_api_ssl_compression = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_ca_certificates_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_num_retries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance_request_timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] goodness_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] graceful_shutdown_timeout = 5 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] group_api_class = cinder.group.api.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] host = devstack {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_compress_on_upload = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_conversion_address_space_limit = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_conversion_cpu_limit = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_conversion_disable = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_introspection_address_space_limit = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_introspection_cpu_limit = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_upload_use_cinder_backend = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_upload_use_internal_tenant = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_volume_cache_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_volume_cache_max_count = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] init_host_max_objects_retrieval = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] instance_format = [instance: %(uuid)s] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iscsi_target_flags = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iscsi_write_cache = on {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iser_helper = tgtadm {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iser_ip_address = 192.168.122.140 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iser_port = 3260 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_color = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_config_append = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_dir = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_options = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_rotate_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_rotate_interval_type = days {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] log_rotation_type = none {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] max_age = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] max_logfile_count = 30 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] max_logfile_size_mb = 200 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] max_over_subscription_ratio = 20.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] message_reap_interval = 86400 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] message_ttl = 2592000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] monkey_patch = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] monkey_patch_modules = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] my_ip = 192.168.122.140 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] no_snapshot_gb_quota = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] num_iser_scan_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] num_shell_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.remotefs [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86612) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] num_volume_device_scan_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] nvmeof_conn_info_version = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] nvmet_ns_id = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] nvmet_port_id = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_max_limit = 1000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_ext_list = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_listen_port = 8776 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_use_ssl = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] osapi_volume_workers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] per_volume_size_limit = -1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] periodic_fuzzy_delay = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] periodic_interval = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] public_endpoint = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] publish_errors = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_backup_gigabytes = 1000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_backups = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_gigabytes = 1000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_groups = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_snapshots = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] quota_volumes = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] rate_limit_burst = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] rate_limit_except_level = CRITICAL {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] rate_limit_interval = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] reinit_driver_count = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] replication_device = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] report_discard_supported = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] report_interval = 120 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] reservation_clean_interval = 86400 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] reservation_expire = 86400 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] reserved_image_namespaces = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] reserved_percentage = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] rpc_response_timeout = 120 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] run_external_periodic_tasks = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] scst_target_driver = iscsi {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] scst_target_iqn_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_down_time = 720 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] shell_completion = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] snapshot_name_template = snapshot-%s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] split_loggers = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] state_path = /opt/stack/data/cinder {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] storage_availability_zone = nova {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] storage_protocol = iSCSI {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] syslog_log_facility = LOG_USER {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_helper = lioadm {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_ip_address = 192.168.122.140 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_port = 3260 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_protocol = iscsi {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] target_secondary_ip_addresses = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] trace_flags = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] transport_url = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] until_refresh = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_chap_auth = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_default_quota_class = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_journal = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_json = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_multipath_for_image_xfer = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_stderr = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] use_syslog = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] verify_glance_signatures = enabled {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_api_class = cinder.volume.api.API {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_backend_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_clear = zero {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_clear_ionice = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_clear_size = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_copy_bps_limit = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_dd_blocksize = 1M {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_name_template = volume-%s {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_service_inithost_offload = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volume_usage_audit_period = month {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] zoning_mode = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.auth_section = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.auth_type = password {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.auth_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.cache = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.interface = public {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcache_username = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.region_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.service_type = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.backend = dogpile.cache.null {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.backend_argument = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.backend_expiration_time = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.config_prefix = cache.oslo {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.debug_cache_backend = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.enable_retry_client = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.enable_socket_keepalive = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.expiration_time = 600 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_dead_retry = 300 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_sasl_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.proxies = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.redis_db = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.redis_server = localhost:6379 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.retry_attempts = 2 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.retry_delay = 0.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.socket_keepalive_count = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.socket_keepalive_idle = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.socket_keepalive_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.socket_timeout = 1.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.tls_allowed_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.tls_cafile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.tls_certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.tls_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86612) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.tls_keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cache.username = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] coordination.backend_url = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.asyncio_connection = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.asyncio_slave_connection = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.backend = sqlalchemy {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.connection = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.connection_debug = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.connection_parameters = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.connection_recycle_time = 3600 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.connection_trace = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.db_inc_retry_interval = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.db_max_retries = 20 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.db_max_retry_interval = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.db_retry_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.max_overflow = 50 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.max_pool_size = 5 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.max_retries = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.pool_timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.retry_interval = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.slave_connection = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.sqlite_synchronous = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.synchronous_reader = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] database.use_db_reconnect = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: WARNING cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_tracing.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.connection_string = messaging:// {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.es_doc_type = notification {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.es_scroll_size = 10000 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: WARNING cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.es_scroll_time = 2m {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.filter_error_trace = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.hmac_keys = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.sentinel_service_name = mymaster {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.socket_timeout = 0.1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.trace_requests = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler.trace_sqlalchemy = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler_jaeger.process_tags = {} {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] profiler_otlp.service_name_prefix = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.policy_default_rule = default {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.group = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.helper_command = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] privsep_osbrick.user = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.group = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.helper_command = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Running cmd (subprocess): mount.quobyte {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] cinder_sys_admin.user = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.auth_section = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.auth_type = password {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.cafile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.collect_timing = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.send_service_user_token = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.split_loggers = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.tls_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] service_user.tls_min_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.auth_section = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.auth_type = password {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.collect_timing = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.region_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.split_loggers = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.tls_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] glance.tls_min_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.backend_availability_zone = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.chap_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.chap_username = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.disk_geometry = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_client_cert = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_data_namespace = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.driver_use_ssl = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.extra_capabilities = {} {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.filter_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.goodness_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iscsi_target_flags = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iser_port = 3260 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_host = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_login = admin {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_mount_options = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_private_key = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_share_path = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.replication_device = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.report_discard_supported = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_helper = tgtadm {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_port = 3260 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_protocol = iscsi {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.trace_flags = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.use_chap_auth = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_backend_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_clear = zero {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_reports.file_event_handler = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_reports.log_dir = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.backend_host = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.chap_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.chap_username = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.disk_geometry = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_client_cert = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.extra_capabilities = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.filter_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.goodness_function = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iser_helper = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iser_ip_address = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iser_port = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_host = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_login = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_mount_options = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_password = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_private_key = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_share_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.num_shell_tries = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.replication_device = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.report_discard_supported = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.reserved_percentage = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.scst_target_driver = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.storage_protocol = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_helper = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_ip_address = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_port = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_prefix = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_protocol = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.trace_flags = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.use_chap_auth = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_clear = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_clear_size = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] QuobyteHD.volumes_dir = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_notifications.driver = [] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] CMD "mount.quobyte" returned: 1 in 0.144s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] key_manager.fixed_key = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.barbican_api_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=86612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.barbican_endpoint = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.barbican_endpoint_type = public {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.barbican_region_name = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: INFO cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 ... Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.cafile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.collect_timing = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 -c /etc/quobyte/client-cinder.cfg {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.number_of_retries = 60 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.retry_delay = 1 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.send_service_user_token = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.split_loggers = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.tls_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.tls_min_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.verify_ssl = True {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican.verify_ssl_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.auth_section = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.auth_type = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.cafile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.certfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.collect_timing = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.insecure = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.keyfile = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.split_loggers = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.timeout = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.tls_ciphers = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] barbican_service_user.tls_min_version = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.approle_role_id = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.approle_secret_id = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.auth_method = approle {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.auth_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.kv_mountpoint = secret {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.kv_path = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.kv_version = 2 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.namespace = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.root_token_id = **** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.ssl_ca_crt_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.timeout = 60.0 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.token_file = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.token_role = None {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.use_ssl = False {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:12:47 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] ******************************************************************************** {{(pid=86393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:12:47 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 -c /etc/quobyte/client-cinder.cfg Nov 06 21:12:47 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:48 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.455s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 succeeded Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=86612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.468s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:48 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:12:48 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:48 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.249s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.volume.driver [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.driver [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_db.sqlalchemy.engines [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG dbcounter [-] [86612] Writer thread running {{(pid=86612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.db.api [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Building query based on filter {{(pid=86612) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.image.image_utils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.keymgr.migration [None req-a2b09b52-e36d-4b5b-ae87-3b5d0c83c7a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=86612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=86612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:48 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:12:48 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:48 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.259s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Notifying Schedulers of capabilities ... {{(pid=86612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Driver initialization completed successfully. Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Initiating service 3 cleanup Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Service 3 cleanup completed. Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.service [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Creating RPC server for service cinder-volume {{(pid=86612) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.service [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86612) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:12:48 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=86612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=86612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:12:48 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:48 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:12:48 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:49 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:49 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.255s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:49 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-c982e6fa-6747-4e87-978a-406bb7713c2c None None] Driver post RPC initialization completed successfully. Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=86612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG cinder.volume.drivers.quobyte [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=86612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:53 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:12:53 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:53 devstack cinder-volume[86393]: INFO oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Caught SIGTERM, stopping children Nov 06 21:12:53 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Acquiring lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:12:53 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Acquired lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:12:53 devstack cinder-volume[86393]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Releasing lock "singleton_lock" {{(pid=86393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:12:53 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Stop services. {{(pid=86393) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:12:53 devstack cinder-volume[86393]: DEBUG oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Killing children. {{(pid=86393) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:12:53 devstack cinder-volume[86393]: INFO oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Waiting on 1 children to exit Nov 06 21:12:53 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG oslo_concurrency.processutils [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.380s {{(pid=86612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:53 devstack cinder-volume[86612]: DEBUG cinder.manager [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Notifying Schedulers of capabilities ... {{(pid=86612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server [None req-8a7e78d6-976f-4151-ba55-736b20fc8443 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server method() Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return _publish( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server listener(*args) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2973, in publish_service_capabilities Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.140:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 06 21:12:53 devstack cinder-volume[86612]: ERROR oslo_messaging.rpc.server Nov 06 21:12:57 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Acquiring lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:12:57 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Acquired lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:12:57 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Releasing lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:12:57 devstack cinder-volume[86612]: WARNING amqp [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:12:57 devstack cinder-volume[86612]: WARNING amqp [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:12:57 devstack cinder-volume[86393]: INFO oslo_service.backend._eventlet.service [None req-e703bfdc-e983-4318-b405-8b6b6564ebb9 None None] Child 86612 exited with status 0 Nov 06 21:12:57 devstack cinder-volume[86931]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:12:57 devstack cinder-volume[86931]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:12:57 devstack cinder-volume[86931]: we strongly recommend against using it for new projects. Nov 06 21:12:57 devstack cinder-volume[86931]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:12:57 devstack cinder-volume[86931]: framework. For more detail see Nov 06 21:12:57 devstack cinder-volume[86931]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:12:57 devstack cinder-volume[86931]: import eventlet # noqa Nov 06 21:13:00 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:13:00 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:13:00 devstack cinder-volume[86931]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:13:01 devstack cinder-volume[86931]: INFO dbcounter [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Registered counter for database cinder Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG dbcounter [-] [86931] Writer thread running {{(pid=86931) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:13:01 devstack cinder-volume[86931]: INFO cinder.rpc [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:13:01 devstack cinder-volume[86931]: INFO cinder.rpc [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:13:01 devstack cinder-volume[86931]: INFO cinder.volume.manager [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Determined volume DB was empty at startup. Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG cinder.volume.manager [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86931) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:13:01 devstack cinder-volume[86931]: WARNING stevedore.named [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:13:01 devstack cinder-volume[86931]: WARNING castellan.key_manager [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:01 devstack cinder-volume[86931]: WARNING cinder.keymgr.conf_key_mgr [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:01 devstack cinder-volume[86931]: INFO cinder.volume.manager [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_db.sqlalchemy.engines [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:13:01 devstack cinder-volume[86931]: INFO oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Starting 1 workers Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Started child 87230 {{(pid=86931) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Full set of CONF: {{(pid=86931) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] Configuration options gathered from: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] ================================================================================ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] allow_availability_zone_fallback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] allow_compression_on_image_upload = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] allowed_direct_url_schemes = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] api_rate_limit = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] auth_strategy = keystone {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_stats_polling_interval = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backup_api_class = cinder.backup.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backup_name_template = backup-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backup_use_same_host = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backup_use_temp_snapshot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] chap_username = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[87230]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_internal_tenant_project_id = 946a51f8d5ce42c1af195a66c61d4c6e {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_internal_tenant_user_id = 77d4ef6c92f445d387cb23cef10fa029 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cluster = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] compression_format = gzip {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] compute_api_class = cinder.compute.nova.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] config_dir = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] config_source = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] control_exchange = openstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] debug = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] default_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] default_group_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] default_volume_type = QuobyteHD {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_ssl_cert_verify = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] driver_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] enable_new_services = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] enable_unsupported_driver = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] enabled_backends = ['QuobyteHD'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] enforce_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_api_insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_api_ssl_compression = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_ca_certificates_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_catalog_info = image:glance:publicURL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_num_retries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance_request_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] graceful_shutdown_timeout = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] group_api_class = cinder.group.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] host = devstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_compress_on_upload = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_conversion_address_space_limit = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_conversion_cpu_limit = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_conversion_disable = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_introspection_address_space_limit = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_introspection_cpu_limit = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_upload_use_cinder_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_upload_use_internal_tenant = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_volume_cache_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_volume_cache_max_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] image_volume_cache_max_size_gb = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] init_host_max_objects_retrieval = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] instance_format = [instance: %(uuid)s] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iscsi_target_flags = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iscsi_write_cache = on {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iser_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iser_ip_address = 192.168.122.140 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iser_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_color = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_config_append = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_options = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_rotate_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_rotate_interval_type = days {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] log_rotation_type = none {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] max_age = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] max_logfile_count = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] max_logfile_size_mb = 200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] max_over_subscription_ratio = 20.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] message_reap_interval = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] message_ttl = 2592000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] migration_create_volume_timeout_secs = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] monkey_patch = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] monkey_patch_modules = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] my_ip = 192.168.122.140 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] no_snapshot_gb_quota = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] num_iser_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] num_shell_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] num_volume_device_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] nvmeof_conn_info_version = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] nvmet_ns_id = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] nvmet_port_id = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_max_limit = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_ext_list = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_listen = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_listen_port = 8776 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] osapi_volume_workers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] per_volume_size_limit = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] periodic_fuzzy_delay = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] periodic_interval = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] project_id_regex = [0-9a-f\-]+ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] public_endpoint = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] publish_errors = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_backup_gigabytes = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_backups = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_gigabytes = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_groups = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_snapshots = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] quota_volumes = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] rate_limit_burst = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] rate_limit_except_level = CRITICAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] rate_limit_interval = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] reinit_driver_count = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] report_discard_supported = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] report_interval = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] reservation_clean_interval = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] reservation_expire = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] reserved_image_namespaces = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] reserved_percentage = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] rpc_response_timeout = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] run_external_periodic_tasks = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] scst_target_driver = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_down_time = 720 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] shell_completion = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] snapshot_name_template = snapshot-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] state_path = /opt/stack/data/cinder {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] storage_availability_zone = nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] storage_protocol = iSCSI {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] syslog_log_facility = LOG_USER {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_helper = lioadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_ip_address = 192.168.122.140 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-86487018-59a3-4336-8022-464498de106c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87230) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_protocol = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] target_secondary_ip_addresses = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] transfer_api_class = cinder.transfer.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] transport_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] until_refresh = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_chap_auth = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_default_quota_class = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_journal = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_json = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_stderr = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] use_syslog = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] verify_glance_signatures = enabled {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_api_class = cinder.volume.api.API {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_clear = zero {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_clear_size = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_copy_bps_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_dd_blocksize = 1M {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_name_template = volume-%s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_service_inithost_offload = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volume_usage_audit_period = month {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] zoning_mode = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_concurrency.disable_process_locking = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.auth_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.include_service_catalog = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.interface = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcache_username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.service_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.backend = dogpile.cache.null {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.backend_argument = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.backend_expiration_time = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.config_prefix = cache.oslo {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.debug_cache_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.enable_retry_client = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.enable_socket_keepalive = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.expiration_time = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.hashclient_retry_attempts = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_dead_retry = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_pool_maxsize = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_sasl_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.proxies = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.redis_db = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.redis_server = localhost:6379 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.retry_attempts = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.retry_delay = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.socket_keepalive_count = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.socket_keepalive_idle = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.socket_keepalive_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.socket_timeout = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.tls_allowed_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.tls_cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.tls_certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.tls_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.tls_keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cache.username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] coordination.backend_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.asyncio_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.asyncio_slave_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.backend = sqlalchemy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.connection_debug = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:01 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.connection_parameters = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.connection_recycle_time = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.connection_trace = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.db_inc_retry_interval = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.db_max_retries = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.db_max_retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.db_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.max_overflow = 50 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.max_pool_size = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.max_retries = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.mysql_wsrep_sync_wait = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.pool_timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.slave_connection = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.sqlite_synchronous = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.synchronous_reader = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] database.use_db_reconnect = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_tracing.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.connection_string = messaging:// {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.es_doc_type = notification {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.es_scroll_size = 10000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.es_scroll_time = 2m {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.filter_error_trace = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.hmac_keys = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.sentinel_service_name = mymaster {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.socket_timeout = 0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.trace_requests = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler.trace_sqlalchemy = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler_jaeger.process_tags = {} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler_jaeger.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] profiler_otlp.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.enforce_new_defaults = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.policy_default_rule = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.policy_file = policy.yaml {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_policy.remote_timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.group = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] privsep_osbrick.user = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.group = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] cinder_sys_admin.user = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.send_service_user_token = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] service_user.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.auth_type = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] glance.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87230) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.chap_username = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] Running cmd (subprocess): mount.quobyte {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.driver_use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.extra_capabilities = {} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iscsi_target_flags = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iscsi_write_cache = on {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iser_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iser_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_host = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_login = admin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_mount_options = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_private_key = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_share_path = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_ssh_port = 22 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.num_shell_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.quobyte_volume_url = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.report_discard_supported = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.reserved_percentage = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_helper = tgtadm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_port = 3260 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_protocol = iscsi {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.unique_fqdn_network = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.use_chap_auth = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_backend_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_clear = zero {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_clear_size = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_reports.file_event_handler = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_reports.log_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.backend_availability_zone = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.backend_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.chap_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.chap_username = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.chiscsi_conf = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.disk_geometry = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_client_cert = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_data_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.driver_use_ssl = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.extra_capabilities = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.filter_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.goodness_function = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iscsi_target_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iscsi_write_cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iser_helper = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iser_ip_address = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iser_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.iser_target_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_host = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_login = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_mount_options = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_password = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_private_key = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_share_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_ssh_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.num_shell_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nvmet_ns_id = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.nvmet_port_id = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.replication_device = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.report_discard_supported = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.reserved_percentage = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.scst_target_driver = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.storage_protocol = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_helper = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_ip_address = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_port = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_protocol = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.trace_flags = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.unique_fqdn_network = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.use_chap_auth = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_clear = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_clear_ionice = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_clear_size = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] QuobyteHD.volumes_dir = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.ssl_version = {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_notifications.driver = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_notifications.retry = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] key_manager.fixed_key = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.barbican_api_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.barbican_endpoint = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.barbican_endpoint_type = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.barbican_region_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.number_of_retries = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.retry_delay = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.send_service_user_token = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.verify_ssl = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican.verify_ssl_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.auth_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.tls_ciphers = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] barbican_service_user.tls_min_version = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.approle_role_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.approle_secret_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.auth_method = approle {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.auth_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.kv_mountpoint = secret {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.kv_path = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.kv_version = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.root_token_id = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.ssl_ca_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.timeout = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.token_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.token_role = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.use_ssl = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:13:02 devstack cinder-volume[86931]: DEBUG oslo_service.backend._eventlet.service [None req-419dc607-f3b0-4672-b563-4fb31f816fdd None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:13:02 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:13:02 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:02 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.volume.driver [None req-86487018-59a3-4336-8022-464498de106c None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.driver [None req-86487018-59a3-4336-8022-464498de106c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_db.sqlalchemy.engines [None req-86487018-59a3-4336-8022-464498de106c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writer thread running {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.db.api [None req-86487018-59a3-4336-8022-464498de106c None None] Building query based on filter {{(pid=87230) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-86487018-59a3-4336-8022-464498de106c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87230) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.keymgr.migration [None req-9e54bebe-e8df-479d-bc77-17620407e8a9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:13:02 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:13:02 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:02 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.236s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Driver initialization completed successfully. Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Initiating service 3 cleanup Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Service 3 cleanup completed. Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.service [None req-86487018-59a3-4336-8022-464498de106c None None] Creating RPC server for service cinder-volume {{(pid=87230) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.service [None req-86487018-59a3-4336-8022-464498de106c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87230) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:13:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86487018-59a3-4336-8022-464498de106c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86487018-59a3-4336-8022-464498de106c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:13:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:02 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:13:02 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:03 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86487018-59a3-4336-8022-464498de106c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86487018-59a3-4336-8022-464498de106c None None] Driver post RPC initialization completed successfully. Nov 06 21:13:11 devstack cinder-volume[86931]: DEBUG dbcounter [-] [86931] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86931) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:13:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 6 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:13:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Flow 'volume_create_manager' (fb4b4f6f-d4a5-44e4-9573-3aab70f10e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5cf550-5803-4122-893f-826166e68920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5cf550-5803-4122-893f-826166e68920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2099207923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f174df-9611-4c01-b8ea-22a05bf131e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2223b971a147d09783c9e20a4bdb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:01Z,use_quota=True,user_id='ebfc7762f2c14105b15a3902439ce186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76c7533-d6a5-4d31-9e0c-347a255020f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76c7533-d6a5-4d31-9e0c-347a255020f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc670ca2-17bb-4fcf-8e68-e4672e0a6c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc670ca2-17bb-4fcf-8e68-e4672e0a6c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f174df-9611-4c01-b8ea-22a05bf131e6', 'volume_name': 'volume-c8f174df-9611-4c01-b8ea-22a05bf131e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab287184-da3b-466d-9e3e-53914fa5d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab287184-da3b-466d-9e3e-53914fa5d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e810cc9-0d3f-4af5-9905-9bd948c95256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Volume c8f174df-9611-4c01-b8ea-22a05bf131e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f174df-9611-4c01-b8ea-22a05bf131e6', 'volume_size': 1} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2099207923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f174df-9611-4c01-b8ea-22a05bf131e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2223b971a147d09783c9e20a4bdb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:01Z,use_quota=True,user_id='ebfc7762f2c14105b15a3902439ce186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Creating volume c8f174df-9611-4c01-b8ea-22a05bf131e6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:14:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:14:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:01 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 1073741824 Nov 06 21:14:01 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:02 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 1073741824" returned: 0 in 0.709s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 Nov 06 21:14:02 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:02 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6" returned: 0 in 0.311s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e810cc9-0d3f-4af5-9905-9bd948c95256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f174df-9611-4c01-b8ea-22a05bf131e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9bb4d-0710-435f-97ec-ae3aeea684bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Volume volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 (c8f174df-9611-4c01-b8ea-22a05bf131e6): created successfully Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9bb4d-0710-435f-97ec-ae3aeea684bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Flow 'volume_create_manager' (fb4b4f6f-d4a5-44e4-9573-3aab70f10e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-79b272f5-56d4-4a32-bc93-81d0ed6e47d9 tempest-TaggedAttachmentsTest-2042646691 None] Created volume successfully. Nov 06 21:14:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:12 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Flow 'volume_create_manager' (5a77d1f9-5caf-4cf1-b6ab-d6b059216655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1aff69-f50c-4ef0-8538-7d4da28ba61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1aff69-f50c-4ef0-8538-7d4da28ba61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-955810568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406f4b0f-a3bd-4d68-acfa-b8b30629ed97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e4d847ad6a4099a52fa2762ad3ad01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:20Z,use_quota=True,user_id='ade6a83fb3494c2b8ac86cd7f2b8cc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc8f5cf-009e-4908-8c83-385aceb3f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc8f5cf-009e-4908-8c83-385aceb3f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362dd9c3-218e-4570-86f0-bea67db76b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362dd9c3-218e-4570-86f0-bea67db76b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406f4b0f-a3bd-4d68-acfa-b8b30629ed97', 'volume_name': 'volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f05bc7-a5fd-409d-92fd-ae43cd3d7153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f05bc7-a5fd-409d-92fd-ae43cd3d7153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa14e44-49b2-4ec9-a4c8-d0f910f10c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Volume 406f4b0f-a3bd-4d68-acfa-b8b30629ed97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97', 'volume_size': 1} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-955810568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406f4b0f-a3bd-4d68-acfa-b8b30629ed97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e4d847ad6a4099a52fa2762ad3ad01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:20Z,use_quota=True,user_id='ade6a83fb3494c2b8ac86cd7f2b8cc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Creating volume 406f4b0f-a3bd-4d68-acfa-b8b30629ed97 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:14:20 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:14:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:20 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 1073741824 Nov 06 21:14:20 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:21 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 1073741824" returned: 0 in 1.067s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 Nov 06 21:14:21 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:22 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa14e44-49b2-4ec9-a4c8-d0f910f10c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b34ddf-afce-4cbe-b7be-d8499a34c2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Volume volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 (406f4b0f-a3bd-4d68-acfa-b8b30629ed97): created successfully Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b34ddf-afce-4cbe-b7be-d8499a34c2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Flow 'volume_create_manager' (5a77d1f9-5caf-4cf1-b6ab-d6b059216655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-65f46f2e-deb4-4ddc-bd7a-af72f48670bd tempest-DeleteServersTestJSON-1620612563 None] Created volume successfully. Nov 06 21:14:27 devstack cinder-volume[87230]: WARNING py.warnings [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 06 21:14:27 devstack cinder-volume[87230]: .first() Nov 06 21:14:27 devstack cinder-volume[87230]: Nov 06 21:14:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb194655-0957-4902-9e82-7f26a546e4d5', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:14:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-564df7fc-3e56-4e17-a044-6693ae3abbb9 req-eae47371-2537-43fb-983c-1ddf71a81107 tempest-DeleteServersTestJSON-1620612563 None] attachment_update completed successfully. Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Flow 'volume_create_manager' (1a870ab1-9700-4519-8274-00af1f86654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb0146d-22c8-4719-bc29-f45b5e46a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb0146d-22c8-4719-bc29-f45b5e46a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1918949675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b17aeb6-ffc7-402f-b4d8-f549957054e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd39bf3819142abbd7aaf3f9081f046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:36Z,use_quota=True,user_id='2233bf36300b4ea9a672b54ef0752ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dca879-b57e-4325-a67d-c3725050d244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dca879-b57e-4325-a67d-c3725050d244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e0052-6ec1-4849-b1df-ce6a599d235e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7e0052-6ec1-4849-b1df-ce6a599d235e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b17aeb6-ffc7-402f-b4d8-f549957054e1', 'volume_name': 'volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e05e88b-a13e-4d2c-b59e-e392506bf3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e05e88b-a13e-4d2c-b59e-e392506bf3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af8f72c-1245-4aee-81a0-3724fa4c52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Volume 3b17aeb6-ffc7-402f-b4d8-f549957054e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1', 'volume_size': 1} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1918949675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b17aeb6-ffc7-402f-b4d8-f549957054e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd39bf3819142abbd7aaf3f9081f046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:14:36Z,use_quota=True,user_id='2233bf36300b4ea9a672b54ef0752ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Creating volume 3b17aeb6-ffc7-402f-b4d8-f549957054e1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:14:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:36 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 1073741824 Nov 06 21:14:36 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-f9848140-7edd-48af-a045-361d3808b5e6 req-2690f84e-3f15-43d7-bca5-43bbb563ce5e tempest-DeleteServersTestJSON-1620612563 None] Terminate volume connection completed successfully. Nov 06 21:14:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-f9848140-7edd-48af-a045-361d3808b5e6 req-2690f84e-3f15-43d7-bca5-43bbb563ce5e tempest-DeleteServersTestJSON-1620612563 None] Deleting attachment fb194655-0957-4902-9e82-7f26a546e4d5. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:14:37 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 1073741824" returned: 0 in 1.180s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:37 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 Nov 06 21:14:37 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:37 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:14:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af8f72c-1245-4aee-81a0-3724fa4c52d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55e6531-2286-4eb5-b4c7-26d9aa6ae841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:14:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Volume volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 (3b17aeb6-ffc7-402f-b4d8-f549957054e1): created successfully Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55e6531-2286-4eb5-b4c7-26d9aa6ae841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Flow 'volume_create_manager' (1a870ab1-9700-4519-8274-00af1f86654f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:14:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3a585fa1-dd43-4c2c-9395-341a8a8c9d56 tempest-VolumesAdminNegativeTest-451611302 None] Created volume successfully. Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:38 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:14:38 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:38 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.566s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 6 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:14:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:14:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "cinder-406f4b0f-a3bd-4d68-acfa-b8b30629ed97-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:14:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "cinder-406f4b0f-a3bd-4d68-acfa-b8b30629ed97-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:14:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "cinder-quobyte-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:14:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "cinder-quobyte-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:14:39 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzivot7gh/privsep.sock'] Nov 06 21:14:39 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzivot7gh/privsep.sock Nov 06 21:14:39 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Acquiring lock "cinder-3b17aeb6-ffc7-402f-b4d8-f549957054e1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:14:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "cinder-3b17aeb6-ffc7-402f-b4d8-f549957054e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:14:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Acquiring lock "cinder-quobyte-3b17aeb6-ffc7-402f-b4d8-f549957054e1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:14:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "cinder-quobyte-3b17aeb6-ffc7-402f-b4d8-f549957054e1" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 21:14:42 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:42 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Spawned new privsep daemon via rootwrap Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Accepted privsep connection to /tmp/tmpzivot7gh/privsep.sock {{(pid=87230) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 21:14:42 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 21:14:42 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 21:14:42 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 21:14:42 devstack cinder-volume[87230]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88898 Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede029f-cfe1-4094-bdda-8dd376ffba4b]: (2,) {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:14:42 devstack cinder-volume[87230]: WARNING oslo_privsep.priv_context [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] privsep daemon already running Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9d56f-a84b-4b26-a35b-2dab96d734c1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfecbcf-03d9-4536-85af-6ffcba149e70]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:14:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:42 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 Nov 06 21:14:42 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:42 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 Nov 06 21:14:42 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:43 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" returned: 0 in 0.597s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:43 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97 Nov 06 21:14:43 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:43 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1" returned: 0 in 0.779s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:43 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1 Nov 06 21:14:43 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:43 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" returned: 0 in 0.375s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "cinder-quobyte-406f4b0f-a3bd-4d68-acfa-b8b30629ed97" released by "delete_volume" :: held 3.587s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:14:43 devstack cinder-volume[87230]: WARNING cinder.quota [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:14:43 devstack cinder-volume[87230]: WARNING cinder.quota [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Created reservations ['14ee25e4-6016-46a3-9afe-c4503249105d', '82be1bbe-f682-43ad-a66a-2d9f19abe12d', 'c2085245-4357-458d-8bf2-4a27012260ce', '8c869f02-fd42-4b93-94b7-eb8253d0e646'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:14:43 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3b17aeb6-ffc7-402f-b4d8-f549957054e1" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "cinder-quobyte-3b17aeb6-ffc7-402f-b4d8-f549957054e1" released by "delete_volume" :: held 2.465s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Created reservations ['7631833a-30b2-4e75-84cb-b9f9a2c8c480', '2ef024f4-b568-4624-b164-086bcb15a2f0', '209bbe90-8c52-46b1-82f2-57e49fd7429e', '971448d2-bcd7-4aec-96c7-f61083f11179'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:43 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:14:43 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:44 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:14:44 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:44 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Deleted volume successfully. Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4381c663-a88f-49f1-bc2e-8beec339c502 tempest-VolumesAdminNegativeTest-451611302 None] Lock "cinder-3b17aeb6-ffc7-402f-b4d8-f549957054e1-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:14:44 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Deleted volume successfully. Nov 06 21:14:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-883bc34f-2ad9-4e47-8939-cad65cedd719 tempest-DeleteServersTestJSON-1620612563 None] Lock "cinder-406f4b0f-a3bd-4d68-acfa-b8b30629ed97-delete_volume" released by "delete_volume" :: held 4.904s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:14:54 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:54 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=21,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-00867173-3bf4-45c7-a052-9b04f7e78f31 req-51ae3401-7fc8-49f0-9f68-ad27e236e9c7 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-00867173-3bf4-45c7-a052-9b04f7e78f31 req-51ae3401-7fc8-49f0-9f68-ad27e236e9c7 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-00867173-3bf4-45c7-a052-9b04f7e78f31 req-51ae3401-7fc8-49f0-9f68-ad27e236e9c7 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-00867173-3bf4-45c7-a052-9b04f7e78f31 req-51ae3401-7fc8-49f0-9f68-ad27e236e9c7 tempest-TaggedAttachmentsTest-2042646691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-c8f174df-9611-4c01-b8ea-22a05bf131e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03c502ba-c8f0-4409-9144-d625a3358eb4', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:15:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-00867173-3bf4-45c7-a052-9b04f7e78f31 req-51ae3401-7fc8-49f0-9f68-ad27e236e9c7 tempest-TaggedAttachmentsTest-2042646691 None] attachment_update completed successfully. Nov 06 21:15:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-6f36e2e6-f1ab-4ce2-b92e-b646a761e9ed req-2647712e-d9b8-482e-91ca-aa16f2b70567 tempest-TaggedAttachmentsTest-2042646691 None] Terminate volume connection completed successfully. Nov 06 21:15:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6f36e2e6-f1ab-4ce2-b92e-b646a761e9ed req-2647712e-d9b8-482e-91ca-aa16f2b70567 tempest-TaggedAttachmentsTest-2042646691 None] Deleting attachment 03c502ba-c8f0-4409-9144-d625a3358eb4. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:15:35 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:35 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:38 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:15:38 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:38 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.795s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (688872f4-e40e-42fa-97a3-7210fa37b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d4ea1b-f4d8-4f0b-8746-0310552c7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d4ea1b-f4d8-4f0b-8746-0310552c7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-583022434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9780b7-c698-4a65-afbd-02cb22e26662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:45Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3aa809-f26f-485d-a823-9e99ddda012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3aa809-f26f-485d-a823-9e99ddda012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9adac-eaea-4955-8a12-b67634c954fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9adac-eaea-4955-8a12-b67634c954fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9780b7-c698-4a65-afbd-02cb22e26662', 'volume_name': 'volume-0f9780b7-c698-4a65-afbd-02cb22e26662', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d6d2b6-1bfd-42d7-b0b9-91f4af642f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d6d2b6-1bfd-42d7-b0b9-91f4af642f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caec1f31-67fe-409a-9140-4005f2889be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Volume 0f9780b7-c698-4a65-afbd-02cb22e26662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9780b7-c698-4a65-afbd-02cb22e26662', 'volume_size': 1} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-583022434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9780b7-c698-4a65-afbd-02cb22e26662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:45Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Creating volume 0f9780b7-c698-4a65-afbd-02cb22e26662 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:15:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:45 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 1073741824 Nov 06 21:15:45 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:46 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 1073741824" returned: 0 in 0.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:46 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 Nov 06 21:15:46 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:46 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662" returned: 0 in 0.529s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caec1f31-67fe-409a-9140-4005f2889be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9780b7-c698-4a65-afbd-02cb22e26662', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100e7ae2-ee86-471a-93e8-138e5379fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Flow 'volume_create_manager' (6040a500-0100-45fd-b225-08404336c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b77fc-d08d-4e59-bc81-8f9ab446b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b77fc-d08d-4e59-bc81-8f9ab446b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1678247790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e2e0da-8d3d-4b03-a96f-2c639f3237f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4040546e96fd49ddaf75296e835a00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:47Z,use_quota=True,user_id='04bae313ad8340479eae8912e68c74fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eac561b-1f2f-471a-a045-0fa0da4f2593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eac561b-1f2f-471a-a045-0fa0da4f2593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891b46fd-c2d2-4d21-8b32-c919b491d6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891b46fd-c2d2-4d21-8b32-c919b491d6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e2e0da-8d3d-4b03-a96f-2c639f3237f8', 'volume_name': 'volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4148ce47-8ad2-40c8-a386-7aa0cc40c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4148ce47-8ad2-40c8-a386-7aa0cc40c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b68615-4b80-4344-ad69-81824c7c99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Volume 72e2e0da-8d3d-4b03-a96f-2c639f3237f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8', 'volume_size': 1} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1678247790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e2e0da-8d3d-4b03-a96f-2c639f3237f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4040546e96fd49ddaf75296e835a00c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:47Z,use_quota=True,user_id='04bae313ad8340479eae8912e68c74fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Creating volume 72e2e0da-8d3d-4b03-a96f-2c639f3237f8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Volume volume-0f9780b7-c698-4a65-afbd-02cb22e26662 (0f9780b7-c698-4a65-afbd-02cb22e26662): created successfully Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100e7ae2-ee86-471a-93e8-138e5379fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (688872f4-e40e-42fa-97a3-7210fa37b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a138c5d1-7def-46c9-a5be-ee04c3943180 tempest-AttachVolumeNegativeTest-1247748641 None] Created volume successfully. Nov 06 21:15:46 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 1073741824 Nov 06 21:15:46 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:47 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 1073741824" returned: 0 in 0.866s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:47 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 Nov 06 21:15:47 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:48 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b68615-4b80-4344-ad69-81824c7c99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5d8eff-e77e-472a-ae76-20e0bcb2622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Volume volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 (72e2e0da-8d3d-4b03-a96f-2c639f3237f8): created successfully Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5d8eff-e77e-472a-ae76-20e0bcb2622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Flow 'volume_create_manager' (6040a500-0100-45fd-b225-08404336c30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b49f20df-2653-46be-a740-8a23b14378fc tempest-ServerRescueNegativeTestJSON-1992860374 None] Created volume successfully. Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-7cc711b5-ee98-43fd-897e-218d31adf4cf req-e82b3e9a-2e3f-4c98-a9b1-07f274a9d783 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-7cc711b5-ee98-43fd-897e-218d31adf4cf req-e82b3e9a-2e3f-4c98-a9b1-07f274a9d783 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-7cc711b5-ee98-43fd-897e-218d31adf4cf req-e82b3e9a-2e3f-4c98-a9b1-07f274a9d783 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-7cc711b5-ee98-43fd-897e-218d31adf4cf req-e82b3e9a-2e3f-4c98-a9b1-07f274a9d783 tempest-AttachVolumeNegativeTest-1247748641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-0f9780b7-c698-4a65-afbd-02cb22e26662', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75e97529-701a-4eee-b850-a5b82db1ffc3', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:15:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-7cc711b5-ee98-43fd-897e-218d31adf4cf req-e82b3e9a-2e3f-4c98-a9b1-07f274a9d783 tempest-AttachVolumeNegativeTest-1247748641 None] attachment_update completed successfully. Nov 06 21:15:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "cinder-c8f174df-9611-4c01-b8ea-22a05bf131e6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "cinder-c8f174df-9611-4c01-b8ea-22a05bf131e6-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "cinder-quobyte-c8f174df-9611-4c01-b8ea-22a05bf131e6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "cinder-quobyte-c8f174df-9611-4c01-b8ea-22a05bf131e6" acquired by "delete_volume" :: waited 0.062s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ca4c7-81fb-4748-8f6d-e1b3148619f2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:15:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:50 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 Nov 06 21:15:50 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:51 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6" returned: 0 in 0.792s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:51 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6 Nov 06 21:15:51 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:51 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c8f174df-9611-4c01-b8ea-22a05bf131e6" returned: 0 in 0.581s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "cinder-quobyte-c8f174df-9611-4c01-b8ea-22a05bf131e6" released by "delete_volume" :: held 1.474s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Created reservations ['509a8917-5b93-41ad-9989-ea74629741cd', '67bfa8a3-c868-4377-85a0-11488fe49ec5', 'c8bf47d4-5cf1-4b2f-900f-41e7388cab1f', 'bf9b547e-32b7-4144-aa0f-dc796eff83e9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:51 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:15:51 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:15:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Deleted volume successfully. Nov 06 21:15:52 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5a0608a5-91e1-41b1-a875-38ab5a0b7f92 tempest-TaggedAttachmentsTest-2042646691 None] Lock "cinder-c8f174df-9611-4c01-b8ea-22a05bf131e6-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:01 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:02 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Acquiring lock "cinder-72e2e0da-8d3d-4b03-a96f-2c639f3237f8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "cinder-72e2e0da-8d3d-4b03-a96f-2c639f3237f8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Acquiring lock "cinder-quobyte-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "cinder-quobyte-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" acquired by "delete_volume" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d318d11d-f906-428d-8a44-151f81f8289c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:06 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 Nov 06 21:16:06 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:06 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" returned: 0 in 0.626s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:06 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8 Nov 06 21:16:06 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" returned: 0 in 0.960s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:07 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "cinder-quobyte-72e2e0da-8d3d-4b03-a96f-2c639f3237f8" released by "delete_volume" :: held 1.750s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Created reservations ['18a8a657-8242-40c4-a6a9-7e940ecb0597', 'b7830d4e-5665-44b2-b2d3-c6b882b7b575', '29f27cb4-3714-4b0e-9f4f-92a9366f123a', '29312db9-02a9-4b7e-8756-7d08ea0448f6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:08 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:16:08 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:09 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 1.155s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:09 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Deleted volume successfully. Nov 06 21:16:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a5b2aa1a-360f-4b65-842a-e9f6e3ca8237 tempest-ServerRescueNegativeTestJSON-1992860374 None] Lock "cinder-72e2e0da-8d3d-4b03-a96f-2c639f3237f8-delete_volume" released by "delete_volume" :: held 4.028s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:18 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:38 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:16:38 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:38 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:16:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Flow 'volume_create_manager' (9d4be39a-a6d9-47bd-b718-61157c269614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc87662-f79e-43e9-9d78-725ef6e1080a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc87662-f79e-43e9-9d78-725ef6e1080a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-629904796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a140f482-ee40-4250-860f-5205a2d9cb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1633bc36d6423a945ead35b6cb3666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:39Z,use_quota=True,user_id='90fb1942911649d0a6e92c0514d2c2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e68f6df-5f73-4c17-bd93-361c88415d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e68f6df-5f73-4c17-bd93-361c88415d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7638a091-bace-4cd3-be8c-e4032fc00a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7638a091-bace-4cd3-be8c-e4032fc00a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a140f482-ee40-4250-860f-5205a2d9cb19', 'volume_name': 'volume-a140f482-ee40-4250-860f-5205a2d9cb19', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5a2bb8-82b4-4793-8dd0-cff202483d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5a2bb8-82b4-4793-8dd0-cff202483d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cb2cd8-97f1-4548-8549-bb7f1373dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Volume a140f482-ee40-4250-860f-5205a2d9cb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a140f482-ee40-4250-860f-5205a2d9cb19', 'volume_size': 1} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-629904796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a140f482-ee40-4250-860f-5205a2d9cb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1633bc36d6423a945ead35b6cb3666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:39Z,use_quota=True,user_id='90fb1942911649d0a6e92c0514d2c2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Creating volume a140f482-ee40-4250-860f-5205a2d9cb19 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:16:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:16:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:39 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 1073741824 Nov 06 21:16:39 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:40 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 1073741824" returned: 0 in 0.900s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:40 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 Nov 06 21:16:40 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:40 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19" returned: 0 in 0.328s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cb2cd8-97f1-4548-8549-bb7f1373dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a140f482-ee40-4250-860f-5205a2d9cb19', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845ba5fb-5bca-41c2-a45e-2e63a9a2332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Volume volume-a140f482-ee40-4250-860f-5205a2d9cb19 (a140f482-ee40-4250-860f-5205a2d9cb19): created successfully Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845ba5fb-5bca-41c2-a45e-2e63a9a2332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Flow 'volume_create_manager' (9d4be39a-a6d9-47bd-b718-61157c269614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-615dbd99-bf70-4bc6-b1c8-d15da4faf386 tempest-ServerActionsTestOtherA-916861973 None] Created volume successfully. Nov 06 21:16:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4c8fbffb-804b-433c-a546-938b30f3d852 req-73002d8f-d91f-4ca9-9777-2b39ae846a77 tempest-AttachVolumeNegativeTest-1247748641 None] Terminate volume connection completed successfully. Nov 06 21:16:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4c8fbffb-804b-433c-a546-938b30f3d852 req-73002d8f-d91f-4ca9-9777-2b39ae846a77 tempest-AttachVolumeNegativeTest-1247748641 None] Deleting attachment 75e97529-701a-4eee-b850-a5b82db1ffc3. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:16:50 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:57 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Flow 'volume_create_manager' (c9df33be-21cc-436b-abfe-6f4f5c2fb1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad2b26e-d9c5-4774-8e68-b605004f5523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad2b26e-d9c5-4774-8e68-b605004f5523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1896833435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a595dce-5d06-4825-823b-63d4650ba089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972cf54ff88f47c4b26dd36e462808e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:16Z,use_quota=True,user_id='b62f48829f9a497d92f5a81b79419130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fa261-e7cd-423d-9d78-343d2fef22cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fa261-e7cd-423d-9d78-343d2fef22cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fb88c-5538-486f-9e08-a15c86b5046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fb88c-5538-486f-9e08-a15c86b5046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a595dce-5d06-4825-823b-63d4650ba089', 'volume_name': 'volume-9a595dce-5d06-4825-823b-63d4650ba089', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9208b44e-5777-4d72-8a1c-2b1748736e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9208b44e-5777-4d72-8a1c-2b1748736e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a5415a-d3aa-4659-9aaa-405eda49139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Volume 9a595dce-5d06-4825-823b-63d4650ba089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a595dce-5d06-4825-823b-63d4650ba089', 'volume_size': 1} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1896833435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a595dce-5d06-4825-823b-63d4650ba089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972cf54ff88f47c4b26dd36e462808e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:16Z,use_quota=True,user_id='b62f48829f9a497d92f5a81b79419130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Creating volume 9a595dce-5d06-4825-823b-63d4650ba089 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:16 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 1073741824 Nov 06 21:17:16 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:16 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 1073741824" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:16 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 Nov 06 21:17:16 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:17 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089" returned: 0 in 0.304s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a5415a-d3aa-4659-9aaa-405eda49139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a595dce-5d06-4825-823b-63d4650ba089', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbcbfb5-740e-4e73-8bf3-1072172c3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Volume volume-9a595dce-5d06-4825-823b-63d4650ba089 (9a595dce-5d06-4825-823b-63d4650ba089): created successfully Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbcbfb5-740e-4e73-8bf3-1072172c3347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Flow 'volume_create_manager' (c9df33be-21cc-436b-abfe-6f4f5c2fb1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8f40570e-46f0-4e40-9c9d-e65c03795fa2 tempest-AttachVolumeShelveTestJSON-673337471 None] Created volume successfully. Nov 06 21:17:27 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:27 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-187871d7-5a12-4447-bd6e-8814717c1549 req-39a10836-0fdb-4938-b161-dbfc541f897d tempest-AttachVolumeShelveTestJSON-673337471 None] No connector for attachment e48f7eff-725a-4ab4-91b3-55688b97ff01; skipping storage backend terminate_connection call. {{(pid=87230) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5082}} Nov 06 21:17:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-187871d7-5a12-4447-bd6e-8814717c1549 req-39a10836-0fdb-4938-b161-dbfc541f897d tempest-AttachVolumeShelveTestJSON-673337471 None] Deleting attachment e48f7eff-725a-4ab4-91b3-55688b97ff01. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:17:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-3e7cb58b-ffd2-4c8b-9e97-9ad770598975 req-0177a968-a8a1-4350-822e-3e348f5a25ce tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-3e7cb58b-ffd2-4c8b-9e97-9ad770598975 req-0177a968-a8a1-4350-822e-3e348f5a25ce tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-3e7cb58b-ffd2-4c8b-9e97-9ad770598975 req-0177a968-a8a1-4350-822e-3e348f5a25ce tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-3e7cb58b-ffd2-4c8b-9e97-9ad770598975 req-0177a968-a8a1-4350-822e-3e348f5a25ce tempest-ServerActionsTestOtherA-916861973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-a140f482-ee40-4250-860f-5205a2d9cb19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55e6365d-4b4a-4576-a864-8a571aa64de6', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:17:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-3e7cb58b-ffd2-4c8b-9e97-9ad770598975 req-0177a968-a8a1-4350-822e-3e348f5a25ce tempest-ServerActionsTestOtherA-916861973 None] attachment_update completed successfully. Nov 06 21:17:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-8978d95e-3141-4a5a-bf82-c9a715936eb2 tempest-ServerActionsTestOtherA-916861973 None] Terminate volume connection completed successfully. Nov 06 21:17:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-8978d95e-3141-4a5a-bf82-c9a715936eb2 tempest-ServerActionsTestOtherA-916861973 None] Deleting attachment 55e6365d-4b4a-4576-a864-8a571aa64de6. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:17:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-75382820-a894-4d23-a3fb-7dbc48e2540b tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-75382820-a894-4d23-a3fb-7dbc48e2540b tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-75382820-a894-4d23-a3fb-7dbc48e2540b tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-75382820-a894-4d23-a3fb-7dbc48e2540b tempest-ServerActionsTestOtherA-916861973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-a140f482-ee40-4250-860f-5205a2d9cb19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e50ec19f-b962-47ec-8a28-3106b9f0334f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:17:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-1742d1fd-b853-426d-bdc1-fbfd501b2400 req-75382820-a894-4d23-a3fb-7dbc48e2540b tempest-ServerActionsTestOtherA-916861973 None] attachment_update completed successfully. Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (b8c033b8-8683-4130-ba12-c9a60b87972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaad5b4-8d3d-46fa-a155-eeea5ae14a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaad5b4-8d3d-46fa-a155-eeea5ae14a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1226279856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad0981b-ae1a-4dcf-b365-66f513a3120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:34Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508f3813-5b76-4c9a-a7cd-01180562aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508f3813-5b76-4c9a-a7cd-01180562aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b6aca6-d5ed-4469-bc58-8d0070dadad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b6aca6-d5ed-4469-bc58-8d0070dadad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad0981b-ae1a-4dcf-b365-66f513a3120f', 'volume_name': 'volume-dad0981b-ae1a-4dcf-b365-66f513a3120f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed23a712-233a-42d4-98f8-f84a06f1523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed23a712-233a-42d4-98f8-f84a06f1523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03abe57d-bc0b-42d0-a4ec-b724c5d8a935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Volume dad0981b-ae1a-4dcf-b365-66f513a3120f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad0981b-ae1a-4dcf-b365-66f513a3120f', 'volume_size': 1} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1226279856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad0981b-ae1a-4dcf-b365-66f513a3120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:34Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Creating volume dad0981b-ae1a-4dcf-b365-66f513a3120f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:34 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:34 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f 1073741824 Nov 06 21:17:34 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:34 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f 1073741824" returned: 0 in 0.548s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:35 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f Nov 06 21:17:35 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:35 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03abe57d-bc0b-42d0-a4ec-b724c5d8a935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad0981b-ae1a-4dcf-b365-66f513a3120f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482dd4c-89e3-4a56-9a29-4186099e2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Volume volume-dad0981b-ae1a-4dcf-b365-66f513a3120f (dad0981b-ae1a-4dcf-b365-66f513a3120f): created successfully Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482dd4c-89e3-4a56-9a29-4186099e2978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (b8c033b8-8683-4130-ba12-c9a60b87972b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a58678d8-609c-487a-a30f-cfa2ae628ddd tempest-AttachVolumeTestJSON-1992869430 None] Created volume successfully. Nov 06 21:17:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c79cf44-e92c-4729-be8a-d27df2563f04 req-3472980b-8c8b-45a5-9cbd-3944567e1a84 tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c79cf44-e92c-4729-be8a-d27df2563f04 req-3472980b-8c8b-45a5-9cbd-3944567e1a84 tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c79cf44-e92c-4729-be8a-d27df2563f04 req-3472980b-8c8b-45a5-9cbd-3944567e1a84 tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-2c79cf44-e92c-4729-be8a-d27df2563f04 req-3472980b-8c8b-45a5-9cbd-3944567e1a84 tempest-AttachVolumeTestJSON-1992869430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-dad0981b-ae1a-4dcf-b365-66f513a3120f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20e26dc0-9d19-40db-85ef-25634c80af95', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:38 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:17:38 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-2c79cf44-e92c-4729-be8a-d27df2563f04 req-3472980b-8c8b-45a5-9cbd-3944567e1a84 tempest-AttachVolumeTestJSON-1992869430 None] attachment_update completed successfully. Nov 06 21:17:38 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.792s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 8 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (f6d23ab2-22ee-44db-b2c1-b650ef4a09b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c7ab4c-ab91-4978-b57e-afe70b5fb38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c7ab4c-ab91-4978-b57e-afe70b5fb38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294624457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1a5b45-2c8a-4108-b3e9-edb3634e2863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:40Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb632a20-7ab4-4d8b-9db9-ffd2b7751782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb632a20-7ab4-4d8b-9db9-ffd2b7751782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cfae42-d851-4265-9d4e-9f0ae5df67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cfae42-d851-4265-9d4e-9f0ae5df67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1a5b45-2c8a-4108-b3e9-edb3634e2863', 'volume_name': 'volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30265aec-c414-47af-8c14-0c77f3c523da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30265aec-c414-47af-8c14-0c77f3c523da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d0052-619a-48ea-9841-20d773b0640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Volume bc1a5b45-2c8a-4108-b3e9-edb3634e2863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863', 'volume_size': 1} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294624457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1a5b45-2c8a-4108-b3e9-edb3634e2863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:40Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Creating volume bc1a5b45-2c8a-4108-b3e9-edb3634e2863 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:17:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:39 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 1073741824 Nov 06 21:17:39 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:40 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 1073741824" returned: 0 in 1.128s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:41 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 Nov 06 21:17:41 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:41 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" returned: 0 in 0.729s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d0052-619a-48ea-9841-20d773b0640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996b6ec8-3339-4673-b1ac-a56345cfad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Volume volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 (bc1a5b45-2c8a-4108-b3e9-edb3634e2863): created successfully Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996b6ec8-3339-4673-b1ac-a56345cfad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (f6d23ab2-22ee-44db-b2c1-b650ef4a09b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-95809ff0-d8d0-4d79-aa93-7915bedb8f34 tempest-AttachVolumeNegativeTest-1247748641 None] Created volume successfully. Nov 06 21:17:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1dd5f98b-f41f-435b-a60a-dcf79b3c8303 req-c682abd9-2e02-467f-ba9c-acb857415038 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1dd5f98b-f41f-435b-a60a-dcf79b3c8303 req-c682abd9-2e02-467f-ba9c-acb857415038 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-1dd5f98b-f41f-435b-a60a-dcf79b3c8303 req-c682abd9-2e02-467f-ba9c-acb857415038 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-1dd5f98b-f41f-435b-a60a-dcf79b3c8303 req-c682abd9-2e02-467f-ba9c-acb857415038 tempest-AttachVolumeNegativeTest-1247748641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be2c58a7-b81d-498e-bfd4-79316cfb8a0a', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:17:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-1dd5f98b-f41f-435b-a60a-dcf79b3c8303 req-c682abd9-2e02-467f-ba9c-acb857415038 tempest-AttachVolumeNegativeTest-1247748641 None] attachment_update completed successfully. Nov 06 21:17:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-610df2dd-3187-4449-884a-9b68deea6573 req-a0ea7020-84ee-4c4a-8ecb-d1b12c9dfc05 tempest-AttachVolumeNegativeTest-1247748641 None] Terminate volume connection completed successfully. Nov 06 21:17:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-610df2dd-3187-4449-884a-9b68deea6573 req-a0ea7020-84ee-4c4a-8ecb-d1b12c9dfc05 tempest-AttachVolumeNegativeTest-1247748641 None] Deleting attachment be2c58a7-b81d-498e-bfd4-79316cfb8a0a. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:17:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=30,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=36,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-7dfdb73b-0e95-4a04-afee-a7ce2e65fede req-bdde0545-3a55-4859-a621-e6cb5b8e2471 tempest-ServerActionsTestOtherA-916861973 None] Terminate volume connection completed successfully. Nov 06 21:18:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-7dfdb73b-0e95-4a04-afee-a7ce2e65fede req-bdde0545-3a55-4859-a621-e6cb5b8e2471 tempest-ServerActionsTestOtherA-916861973 None] Deleting attachment e50ec19f-b962-47ec-8a28-3106b9f0334f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Acquiring lock "cinder-9a595dce-5d06-4825-823b-63d4650ba089-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "cinder-9a595dce-5d06-4825-823b-63d4650ba089-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Acquiring lock "cinder-quobyte-9a595dce-5d06-4825-823b-63d4650ba089" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "cinder-quobyte-9a595dce-5d06-4825-823b-63d4650ba089" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeaff5a-b3c8-49e2-87e3-9f597087b651]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:25 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 Nov 06 21:18:25 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:25 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089" returned: 0 in 0.358s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:25 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089 Nov 06 21:18:25 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:25 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9a595dce-5d06-4825-823b-63d4650ba089" returned: 0 in 0.249s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "cinder-quobyte-9a595dce-5d06-4825-823b-63d4650ba089" released by "delete_volume" :: held 0.660s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Created reservations ['47082747-825b-423c-90e0-384ce023fe7e', 'bad088c2-8986-4461-acd9-8b0c05836f50', '7b1551ac-8eb6-4205-9deb-642f42ce7720', 'e282c1b8-a5e3-4672-b6b5-9db5b19afa44'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:25 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:25 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:26 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Deleted volume successfully. Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3248ebca-a60e-4714-9707-1e1f0c0f0bc4 tempest-AttachVolumeShelveTestJSON-673337471 None] Lock "cinder-9a595dce-5d06-4825-823b-63d4650ba089-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Flow 'volume_create_manager' (ec372cb3-ac81-4c48-8722-9655e483a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f7e04a-14bb-4d64-a4e2-e7d9031339c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f7e04a-14bb-4d64-a4e2-e7d9031339c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538786250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d55ed49-2a0a-4292-bb66-9f0f1287483c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1633bc36d6423a945ead35b6cb3666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:26Z,use_quota=True,user_id='90fb1942911649d0a6e92c0514d2c2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ce7a6c-af0d-4b28-99e6-154b41841fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ce7a6c-af0d-4b28-99e6-154b41841fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71d578e-78aa-403c-8b34-ff4711aaa57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71d578e-78aa-403c-8b34-ff4711aaa57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'volume_name': 'volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4561ad6-7194-45fd-87ed-e322374ee8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4561ad6-7194-45fd-87ed-e322374ee8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff851ff-e2a1-466a-ba89-1dbb5090c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:18:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Trying to clone 1d55ed49-2a0a-4292-bb66-9f0f1287483c from image 007d3188-64b0-400e-a10b-94dd7e89a175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:18:27 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e9ee4-e549-4614-9e27-ae5f094a2f4a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:27 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD Nov 06 21:18:27 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:27 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 is fetched for user 90fb1942911649d0a6e92c0514d2c2cb. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c5a10-bcb1-4604-a9b6-e993663792df]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-fdffda8f-fff9-4e59-b587-e78295eb8520 req-46de5e8e-32ea-4e91-8e99-37a9b648987c tempest-AttachVolumeTestJSON-1992869430 None] Terminate volume connection completed successfully. Nov 06 21:18:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-fdffda8f-fff9-4e59-b587-e78295eb8520 req-46de5e8e-32ea-4e91-8e99-37a9b648987c tempest-AttachVolumeTestJSON-1992869430 None] Deleting attachment 20e26dc0-9d19-40db-85ef-25634c80af95. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:27 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD Nov 06 21:18:27 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:28 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538786250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d55ed49-2a0a-4292-bb66-9f0f1287483c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1633bc36d6423a945ead35b6cb3666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:26Z,use_quota=True,user_id='90fb1942911649d0a6e92c0514d2c2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Creating volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:28 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:28 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1073741824 Nov 06 21:18:28 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:28 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1073741824" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:29 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c Nov 06 21:18:29 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:29 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Attempting download of 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0824414-a1bc-463d-a55d-06dbf8f07fb5]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:29 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8 Nov 06 21:18:29 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:29 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8" returned: 0 in 0.337s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:29 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8 Nov 06 21:18:29 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:30 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8" returned: 1 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_4gsjeru8' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cbf0d8-866c-4a8c-b75a-4eb84b9c9bf4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:30 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD Nov 06 21:18:30 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:30 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] 007d3188-64b0-400e-a10b-94dd7e89a175 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:18:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:30 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c Nov 06 21:18:30 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (8cd5e779-1f43-4619-a9df-e3f712b0eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0167e0b-5e35-452d-9ddf-bf1c0552af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0167e0b-5e35-452d-9ddf-bf1c0552af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2034872087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532ca5ea-fb17-4075-a1f5-0951abe7d523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:32Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b92e85-5724-4dc9-9926-2f3b645d41b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b92e85-5724-4dc9-9926-2f3b645d41b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22baaa-9e0a-4d8e-949a-a072f53ce665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22baaa-9e0a-4d8e-949a-a072f53ce665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532ca5ea-fb17-4075-a1f5-0951abe7d523', 'volume_name': 'volume-532ca5ea-fb17-4075-a1f5-0951abe7d523', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a3019-1848-44e7-a27c-7c2b352f6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a3019-1848-44e7-a27c-7c2b352f6df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f316b248-524e-45d9-9a9b-b2cc04794706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Volume 532ca5ea-fb17-4075-a1f5-0951abe7d523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532ca5ea-fb17-4075-a1f5-0951abe7d523', 'volume_size': 1} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2034872087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532ca5ea-fb17-4075-a1f5-0951abe7d523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80dfc4d891e4fd89a9927448697eac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:32Z,use_quota=True,user_id='72ab0e88d28a404a86bc19029804b6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Creating volume 532ca5ea-fb17-4075-a1f5-0951abe7d523 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:32 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 1073741824 Nov 06 21:18:32 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:32 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 1073741824" returned: 0 in 0.941s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:33 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 Nov 06 21:18:33 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:33 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523" returned: 0 in 0.443s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f316b248-524e-45d9-9a9b-b2cc04794706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532ca5ea-fb17-4075-a1f5-0951abe7d523', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fbcc18-fd14-4c8b-8f56-34df67e9841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Volume volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 (532ca5ea-fb17-4075-a1f5-0951abe7d523): created successfully Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fbcc18-fd14-4c8b-8f56-34df67e9841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Flow 'volume_create_manager' (8cd5e779-1f43-4619-a9df-e3f712b0eb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-34c93275-625e-4cf0-b681-6d6a0251d822 tempest-AttachVolumeNegativeTest-1247748641 None] Created volume successfully. Nov 06 21:18:33 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c" returned: 0 in 3.231s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_pbkrpna4devstack@QuobyteHD, size 112.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:18:33 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Converted 112.00 MB image at 34.65 MB/s Nov 06 21:18:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:33 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1G Nov 06 21:18:33 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:34 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c 1G" returned: 0 in 0.808s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Downloaded image 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 for user 90fb1942911649d0a6e92c0514d2c2cb is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Marking volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Copying metadata from image 007d3188-64b0-400e-a10b-94dd7e89a175 to 1d55ed49-2a0a-4292-bb66-9f0f1287483c. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Creating volume glance metadata for volume 1d55ed49-2a0a-4292-bb66-9f0f1287483c backed by image 007d3188-64b0-400e-a10b-94dd7e89a175 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff851ff-e2a1-466a-ba89-1dbb5090c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecf77c9-ab01-4e8e-a164-397dd2d3e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Volume volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c (1d55ed49-2a0a-4292-bb66-9f0f1287483c): created successfully Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecf77c9-ab01-4e8e-a164-397dd2d3e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Flow 'volume_create_manager' (ec372cb3-ac81-4c48-8722-9655e483a90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-191dd085-23b2-49b5-944b-f7581f0364e3 tempest-ServerActionsTestOtherA-916861973 None] Created volume successfully. Nov 06 21:18:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c542efc-1e70-4fce-9154-abeb34ad452c req-7ef1231e-950b-4714-b2cf-7810770002a3 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c542efc-1e70-4fce-9154-abeb34ad452c req-7ef1231e-950b-4714-b2cf-7810770002a3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-2c542efc-1e70-4fce-9154-abeb34ad452c req-7ef1231e-950b-4714-b2cf-7810770002a3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-2c542efc-1e70-4fce-9154-abeb34ad452c req-7ef1231e-950b-4714-b2cf-7810770002a3 tempest-AttachVolumeNegativeTest-1247748641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-532ca5ea-fb17-4075-a1f5-0951abe7d523', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f3ba201-747b-4768-aa60-be3f4fd9ce8c', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:18:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-2c542efc-1e70-4fce-9154-abeb34ad452c req-7ef1231e-950b-4714-b2cf-7810770002a3 tempest-AttachVolumeNegativeTest-1247748641 None] attachment_update completed successfully. Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:38 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:38 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:38 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.474s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Flow 'volume_create_manager' (b2456e90-fec2-4a4f-80bc-0bc388c80dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de9c6c0-fea1-49a9-9439-b35f6a15e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de9c6c0-fea1-49a9-9439-b35f6a15e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-304328662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb40ab43c84a04a6aede191bc9b8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:39Z,use_quota=True,user_id='32e612a22e01490bbc454961442406d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb82c0e-2869-41c1-b162-d19b0e1186c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb82c0e-2869-41c1-b162-d19b0e1186c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707cedca-0084-4896-826c-1ce2ed462db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707cedca-0084-4896-826c-1ce2ed462db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678', 'volume_name': 'volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05b343-62e8-4e7b-9255-94145c3a095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05b343-62e8-4e7b-9255-94145c3a095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7875d70-0c2f-4fbb-b709-0f53a5c02e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Volume e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678', 'volume_size': 1} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-304328662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb40ab43c84a04a6aede191bc9b8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:39Z,use_quota=True,user_id='32e612a22e01490bbc454961442406d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Creating volume e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:38 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:18:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:38 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 1073741824 Nov 06 21:18:38 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-61a19062-2c80-4368-a754-c41bedbcc07a req-795b1b04-cb8a-463b-a3e0-ea48ebd3cdf5 tempest-AttachVolumeNegativeTest-1247748641 None] Terminate volume connection completed successfully. Nov 06 21:18:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-61a19062-2c80-4368-a754-c41bedbcc07a req-795b1b04-cb8a-463b-a3e0-ea48ebd3cdf5 tempest-AttachVolumeNegativeTest-1247748641 None] Deleting attachment 0f3ba201-747b-4768-aa60-be3f4fd9ce8c. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd970e6c-f18a-439a-91d9-ddf25cd16c4a req-9cc2f8de-f119-42b9-bec0-b9f2b487d516 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:39 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 1073741824" returned: 0 in 0.840s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:39 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 Nov 06 21:18:39 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:40 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" returned: 0 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd970e6c-f18a-439a-91d9-ddf25cd16c4a req-9cc2f8de-f119-42b9-bec0-b9f2b487d516 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.543s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7875d70-0c2f-4fbb-b709-0f53a5c02e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f2a5b-f9bc-4582-97f0-822fcc98d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-dd970e6c-f18a-439a-91d9-ddf25cd16c4a req-9cc2f8de-f119-42b9-bec0-b9f2b487d516 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Volume volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 (e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678): created successfully Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97f2a5b-f9bc-4582-97f0-822fcc98d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Flow 'volume_create_manager' (b2456e90-fec2-4a4f-80bc-0bc388c80dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-0bdc9ba8-a854-446c-9df0-9704f1fdd5c7 req-fc017228-ee82-4a77-bfac-1eb273b1475f tempest-VolumesSnapshotsTestJSON-402157745 None] Created volume successfully. Nov 06 21:18:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-dd970e6c-f18a-439a-91d9-ddf25cd16c4a req-9cc2f8de-f119-42b9-bec0-b9f2b487d516 tempest-ServerActionsTestOtherA-916861973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '290f14a6-8609-490e-b6e9-da07a49366f5', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:18:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-dd970e6c-f18a-439a-91d9-ddf25cd16c4a req-9cc2f8de-f119-42b9-bec0-b9f2b487d516 tempest-ServerActionsTestOtherA-916861973 None] attachment_update completed successfully. Nov 06 21:18:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Creating offline snapshot 154e85ef-a7c6-4731-b05c-fa5af95b292d of volume e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:18:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc3ba3-89b4-461b-8eec-8df6ac7986bd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:41 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 Nov 06 21:18:41 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:42 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:42 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d 1G Nov 06 21:18:42 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:43 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d 1G" returned: 0 in 0.912s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:43 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d Nov 06 21:18:43 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:43 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:43 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d is being set with open permissions: ugo+rw Nov 06 21:18:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:43 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d Nov 06 21:18:43 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:44 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:44 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info Nov 06 21:18:44 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:44 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info" returned: 0 in 0.395s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:44 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info is being set with open permissions: ugo+rw Nov 06 21:18:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:44 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info Nov 06 21:18:44 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:45 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.info" returned: 0 in 0.586s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.619s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-88a1c3d7-6352-4e07-8bf7-fd984b94c873 req-52a21f1c-6630-43fd-9a33-45aea711f7d9 tempest-VolumesSnapshotsTestJSON-402157745 None] Create snapshot completed successfully Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "cinder-154e85ef-a7c6-4731-b05c-fa5af95b292d-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-154e85ef-a7c6-4731-b05c-fa5af95b292d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "cinder-quobyte-154e85ef-a7c6-4731-b05c-fa5af95b292d" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-154e85ef-a7c6-4731-b05c-fa5af95b292d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Deleting offline snapshot 154e85ef-a7c6-4731-b05c-fa5af95b292d of volume e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] snapshot_file for this snap is: volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ec885-dca1-4ff6-9aad-b79aee485ba0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:46 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d Nov 06 21:18:46 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:46 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d" returned: 0 in 0.667s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8144636-4562-4592-80df-91ccfabc1aa5]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-532ca5ea-fb17-4075-a1f5-0951abe7d523-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-532ca5ea-fb17-4075-a1f5-0951abe7d523-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:47 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-quobyte-532ca5ea-fb17-4075-a1f5-0951abe7d523" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:47 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-532ca5ea-fb17-4075-a1f5-0951abe7d523" acquired by "delete_volume" :: waited 0.067s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cfaa21-eafd-45b8-a885-c8e883927802]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:47 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 Nov 06 21:18:47 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:47 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" returned: 0 in 0.861s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:47 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d Nov 06 21:18:47 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523" returned: 0 in 0.846s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:48 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523 Nov 06 21:18:48 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d" returned: 0 in 0.833s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:48 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-532ca5ea-fb17-4075-a1f5-0951abe7d523" returned: 0 in 0.437s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d Nov 06 21:18:48 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-532ca5ea-fb17-4075-a1f5-0951abe7d523" released by "delete_volume" :: held 1.354s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Created reservations ['a4b018b5-789b-40b3-b65f-3cadd82f082c', 'dbe21285-a3d9-4020-b5d5-848a1420231e', 'ef235882-3db4-4936-881e-63439b9043b4', 'ae43040c-8fd4-4212-9732-572a7605f774'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:48 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:48 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:48 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678.154e85ef-a7c6-4731-b05c-fa5af95b292d" returned: 0 in 0.358s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-154e85ef-a7c6-4731-b05c-fa5af95b292d" released by "_delete_snapshot" :: held 2.989s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" released by "delete_snapshot" :: held 3.032s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:48 devstack cinder-volume[87230]: WARNING cinder.quota [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.quota [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Created reservations ['88b55795-097d-4b2e-876a-0c06f761c0df', 'ae4f3681-dcc7-49de-bc21-73b2039c165a', 'c53332c7-a252-408c-9815-30afafbee216', '6bfb80bb-79ad-4d37-b4ff-ce354103c693'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Delete snapshot completed successfully. Nov 06 21:18:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-dae392ef-c8cc-4b02-913d-eed83fcab9d3 req-f502ed5a-9bc4-45ed-b8b7-402d4e5f9519 tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-154e85ef-a7c6-4731-b05c-fa5af95b292d-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:49 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.313s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Deleted volume successfully. Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1d60d767-58ac-4cca-842d-a7a9f29ed0e3 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-532ca5ea-fb17-4075-a1f5-0951abe7d523-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "cinder-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-bc1a5b45-2c8a-4108-b3e9-edb3634e2863-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-bc1a5b45-2c8a-4108-b3e9-edb3634e2863-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022714f-37ad-4ba8-99c2-cc3d2e0f6afd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-quobyte-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b16c4-2fd7-4ba5-84a0-3fa4b16d3bcc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:49 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 Nov 06 21:18:49 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:49 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 Nov 06 21:18:49 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:50 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" returned: 0 in 0.598s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:50 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" returned: 0 in 0.508s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:50 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678 Nov 06 21:18:50 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:50 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863 Nov 06 21:18:50 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:50 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" returned: 0 in 0.313s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-quobyte-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678" released by "delete_volume" :: held 1.048s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:50 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" returned: 0 in 0.402s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.quota [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Created reservations ['c966a08e-9d87-4634-94ad-731b38c0499d', '7ac3e17f-5ae3-4036-9039-4318053c26bc', 'af2ab69a-abca-483e-b51f-7f370f904790', '0d5d4a12-302f-4f48-a541-507c5bdc17cb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-bc1a5b45-2c8a-4108-b3e9-edb3634e2863" released by "delete_volume" :: held 0.989s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Created reservations ['531f362b-24a6-4a1b-b132-f1a7ea6fe622', 'f841d82e-3fbf-4b1e-9f13-ec076aaac042', 'e0d8df0b-b9e8-40f8-92a7-75922eda70a0', '1b78ffd8-8cff-4de1-9725-56f4f187fd61'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:50 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:50 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:51 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:51 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:51 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.364s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.manager [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Deleted volume successfully. Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-81289b56-d369-4f3d-879c-d79b856d5ea7 req-8e375d9c-6ba2-4fc0-8960-3891928bfefe tempest-VolumesSnapshotsTestJSON-402157745 None] Lock "cinder-e58c62f6-cfbd-4d76-b8e3-c9fe27c5e678-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:51 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Deleted volume successfully. Nov 06 21:18:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f39af83-2385-4815-880b-5ff7eda40f28 tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-bc1a5b45-2c8a-4108-b3e9-edb3634e2863-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-0f9780b7-c698-4a65-afbd-02cb22e26662-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-0f9780b7-c698-4a65-afbd-02cb22e26662-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "cinder-quobyte-0f9780b7-c698-4a65-afbd-02cb22e26662" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-0f9780b7-c698-4a65-afbd-02cb22e26662" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fef4e3-cf0c-4a0b-8462-84b27d0dec26]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:52 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 Nov 06 21:18:52 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:53 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:53 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662 Nov 06 21:18:53 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:53 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0f9780b7-c698-4a65-afbd-02cb22e26662" returned: 0 in 0.504s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-quobyte-0f9780b7-c698-4a65-afbd-02cb22e26662" released by "delete_volume" :: held 1.406s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Created reservations ['0eb86efc-ec0a-4018-b124-a46b69e800bd', 'b9f7eceb-7e47-4a5f-806b-d2339c8db158', '573eb463-80f4-41e4-a4a8-0e5391e8e298', 'fb9a1805-1d5d-4324-9651-bd95e2c83bd9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:54 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:18:54 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:54 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Deleted volume successfully. Nov 06 21:18:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5354f5e8-3505-4b31-b325-9c290db147ae tempest-AttachVolumeNegativeTest-1247748641 None] Lock "cinder-0f9780b7-c698-4a65-afbd-02cb22e26662-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (a7b22d99-c089-48c0-bf34-91bfcda19c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0858db3-01cb-430c-a22e-9ce2a6d2fc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0858db3-01cb-430c-a22e-9ce2a6d2fc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1716433563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df99ada-05f4-4dc9-932f-aba7a19f5559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:59Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc8a9d9-798d-4783-aadd-dab32174384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc8a9d9-798d-4783-aadd-dab32174384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bed270-e9f8-4541-86fd-681c2829d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bed270-e9f8-4541-86fd-681c2829d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df99ada-05f4-4dc9-932f-aba7a19f5559', 'volume_name': 'volume-5df99ada-05f4-4dc9-932f-aba7a19f5559', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587598af-bf88-440d-938f-4eba3ebfc9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587598af-bf88-440d-938f-4eba3ebfc9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60af66-eda4-4503-a485-08a8ae55e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Volume 5df99ada-05f4-4dc9-932f-aba7a19f5559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df99ada-05f4-4dc9-932f-aba7a19f5559', 'volume_size': 1} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1716433563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df99ada-05f4-4dc9-932f-aba7a19f5559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:59Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Creating volume 5df99ada-05f4-4dc9-932f-aba7a19f5559 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:18:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:59 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 1073741824 Nov 06 21:18:59 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:00 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 1073741824" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:00 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 Nov 06 21:19:00 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:00 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559" returned: 0 in 0.467s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60af66-eda4-4503-a485-08a8ae55e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df99ada-05f4-4dc9-932f-aba7a19f5559', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad0bbea-c1ce-448d-9407-cc12b491ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Volume volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 (5df99ada-05f4-4dc9-932f-aba7a19f5559): created successfully Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad0bbea-c1ce-448d-9407-cc12b491ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (a7b22d99-c089-48c0-bf34-91bfcda19c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bee84086-4831-4910-900b-d17d353836ee tempest-VolumesTestJSON-1624857945 None] Created volume successfully. Nov 06 21:19:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-9e957ef1-8a88-444d-8dcc-ecc7e8d06e99 tempest-ServerActionsTestOtherA-916861973 None] Terminate volume connection completed successfully. Nov 06 21:19:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-9e957ef1-8a88-444d-8dcc-ecc7e8d06e99 tempest-ServerActionsTestOtherA-916861973 None] Deleting attachment 290f14a6-8609-490e-b6e9-da07a49366f5. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (9cfe39b1-2d6d-4317-aaf7-ef6bd09c543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090100cb-1fed-4072-9cfd-f228efec0b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090100cb-1fed-4072-9cfd-f228efec0b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-917705727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3a15f0-3804-4677-b1bb-6e5c51ea894c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:03Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fc355-aa7a-464a-8cba-35698278f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fc355-aa7a-464a-8cba-35698278f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9014a5-ce58-460d-8a8f-196f8ee73d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9014a5-ce58-460d-8a8f-196f8ee73d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3a15f0-3804-4677-b1bb-6e5c51ea894c', 'volume_name': 'volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c9e2c-eed8-4306-8646-446528dcf7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69c9e2c-eed8-4306-8646-446528dcf7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff33774b-39e2-4a8f-9a18-f4626cd1b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Volume fc3a15f0-3804-4677-b1bb-6e5c51ea894c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c', 'volume_size': 1} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-917705727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3a15f0-3804-4677-b1bb-6e5c51ea894c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:03Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Creating volume fc3a15f0-3804-4677-b1bb-6e5c51ea894c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:03 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c 1073741824 Nov 06 21:19:03 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:03 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c 1073741824" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:04 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c Nov 06 21:19:04 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:04 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" returned: 0 in 0.381s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff33774b-39e2-4a8f-9a18-f4626cd1b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6594b6b-df27-4921-99cb-823eddfd38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Volume volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c (fc3a15f0-3804-4677-b1bb-6e5c51ea894c): created successfully Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6594b6b-df27-4921-99cb-823eddfd38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (9cfe39b1-2d6d-4317-aaf7-ef6bd09c543a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-22d06ac9-d601-4d76-956e-f7c1e5a09d8c tempest-VolumesTestJSON-1624857945 None] Created volume successfully. Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-402b32bd-1a4c-477b-92a5-9acb5f2dd6c6 tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-402b32bd-1a4c-477b-92a5-9acb5f2dd6c6 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-402b32bd-1a4c-477b-92a5-9acb5f2dd6c6 tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-402b32bd-1a4c-477b-92a5-9acb5f2dd6c6 tempest-ServerActionsTestOtherA-916861973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '305d1249-3fca-4ac9-904f-a494fe7ecf4f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-facf7d81-2b9f-482d-afe2-64013d35ab10 req-402b32bd-1a4c-477b-92a5-9acb5f2dd6c6 tempest-ServerActionsTestOtherA-916861973 None] attachment_update completed successfully. Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (aeff80a0-ebfa-442b-a024-7d4f631c65da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4195883-abf1-4822-a1cc-977fa099370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4195883-abf1-4822-a1cc-977fa099370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384465069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e22a318-d0f5-4dfe-bd43-e3c0a601e646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:06Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48e87ed-bb67-4a69-bb6a-3d5d1ee11fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48e87ed-bb67-4a69-bb6a-3d5d1ee11fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c071a6cd-7b94-4130-97e3-6e7e964b4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c071a6cd-7b94-4130-97e3-6e7e964b4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e22a318-d0f5-4dfe-bd43-e3c0a601e646', 'volume_name': 'volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7785099-dc08-4c51-84d2-935e158143d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7785099-dc08-4c51-84d2-935e158143d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ccf0b5-925e-47a7-ba96-fe2ab8accc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Volume 0e22a318-d0f5-4dfe-bd43-e3c0a601e646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646', 'volume_size': 1} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384465069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e22a318-d0f5-4dfe-bd43-e3c0a601e646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='656a24929d424e8f9a58970d341edd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:06Z,use_quota=True,user_id='06bc220297bf4da38d0ff27b6758e789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Creating volume 0e22a318-d0f5-4dfe-bd43-e3c0a601e646 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:06 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:19:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:06 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 1073741824 Nov 06 21:19:06 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:07 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 1073741824" returned: 0 in 1.055s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:08 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 Nov 06 21:19:08 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:08 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" returned: 0 in 0.552s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ccf0b5-925e-47a7-ba96-fe2ab8accc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cde339-eb44-4d82-bfa7-34b5a12c2016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Volume volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 (0e22a318-d0f5-4dfe-bd43-e3c0a601e646): created successfully Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cde339-eb44-4d82-bfa7-34b5a12c2016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Flow 'volume_create_manager' (aeff80a0-ebfa-442b-a024-7d4f631c65da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-05ea758b-6b55-4ad1-946e-08303a9a2b2b tempest-VolumesTestJSON-1624857945 None] Created volume successfully. Nov 06 21:19:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-0e22a318-d0f5-4dfe-bd43-e3c0a601e646-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "cinder-0e22a318-d0f5-4dfe-bd43-e3c0a601e646-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-quobyte-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be817c-edd1-45ba-a638-688d13d8d8a5]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:13 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 Nov 06 21:19:13 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:14 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" returned: 0 in 0.883s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:14 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646 Nov 06 21:19:14 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:14 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" returned: 0 in 0.683s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-0e22a318-d0f5-4dfe-bd43-e3c0a601e646" released by "delete_volume" :: held 1.723s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Created reservations ['a42db350-6e26-4513-b29c-d722a801bcd0', '128aada6-f988-4bf7-8583-82a855419a34', '23c02139-aa19-4574-b5e7-67e6697d3b2f', 'b4f3686c-8a13-4c06-9924-77735c2e6f92'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:15 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:15 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-fc3a15f0-3804-4677-b1bb-6e5c51ea894c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "cinder-fc3a15f0-3804-4677-b1bb-6e5c51ea894c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-quobyte-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" acquired by "delete_volume" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fbc6a4-4b41-4d96-aa4c-359fb60c8833]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:16 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c Nov 06 21:19:16 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:16 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.838s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:16 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Deleted volume successfully. Nov 06 21:19:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a37b880-7b43-431d-9fa4-084fbc48512c tempest-VolumesTestJSON-1624857945 None] Lock "cinder-0e22a318-d0f5-4dfe-bd43-e3c0a601e646-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:16 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" returned: 0 in 0.917s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:16 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c Nov 06 21:19:16 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:17 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-fc3a15f0-3804-4677-b1bb-6e5c51ea894c" released by "delete_volume" :: held 1.356s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Created reservations ['a17fea66-6dbe-4319-8bdc-3db353b4d244', '43ff1af1-052e-49e6-b965-aad0ba16e1ef', 'ec760a37-b674-4752-ad9a-6b5cf6f504f9', '43cca015-55a2-4c0a-a786-38248ab6d064'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:17 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:17 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:17 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Deleted volume successfully. Nov 06 21:19:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-063f42a5-5e67-4c66-b744-f4d27e77664d tempest-VolumesTestJSON-1624857945 None] Lock "cinder-fc3a15f0-3804-4677-b1bb-6e5c51ea894c-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-5df99ada-05f4-4dc9-932f-aba7a19f5559-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "cinder-5df99ada-05f4-4dc9-932f-aba7a19f5559-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Acquiring lock "cinder-quobyte-5df99ada-05f4-4dc9-932f-aba7a19f5559" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-5df99ada-05f4-4dc9-932f-aba7a19f5559" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a8384-a406-4d29-b775-9d2ed7b302f3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:18 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 Nov 06 21:19:18 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:18 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559" returned: 0 in 0.538s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:18 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559 Nov 06 21:19:18 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:19 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5df99ada-05f4-4dc9-932f-aba7a19f5559" returned: 0 in 0.365s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "cinder-quobyte-5df99ada-05f4-4dc9-932f-aba7a19f5559" released by "delete_volume" :: held 1.023s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=86,cinder:UPDATE=95,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=93,cinder:INSERT=26,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Created reservations ['0086883b-a4a4-46e1-9dc1-2115ef0ccca9', '5523739a-73b9-4728-914b-148840bd45b0', '1a46750a-7c46-4967-99c2-e82a81fe8970', '833906f8-8aa1-4b83-8667-4c04f90f926b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:19 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:19 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:20 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.870s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Deleted volume successfully. Nov 06 21:19:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f4adc0a4-38f1-47fb-9a61-9d697bd27065 tempest-VolumesTestJSON-1624857945 None] Lock "cinder-5df99ada-05f4-4dc9-932f-aba7a19f5559-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9f9420b6-1f66-446d-a7d1-f3dff5e2ba54 tempest-GroupSnapshotsV319Test-1480150306 None] Group tempest-GroupSnapshotsV319Test-Group-912368763: creating Nov 06 21:19:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9f9420b6-1f66-446d-a7d1-f3dff5e2ba54 tempest-GroupSnapshotsV319Test-1480150306 None] Group tempest-GroupSnapshotsV319Test-Group-912368763: created successfully Nov 06 21:19:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9f9420b6-1f66-446d-a7d1-f3dff5e2ba54 tempest-GroupSnapshotsV319Test-1480150306 None] Create group completed successfully. Nov 06 21:19:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-436acc9a-0ddd-47be-8686-7646f8cb2cd3 tempest-GroupsV320Test-1321850177 None] Group tempest-GroupsV320Test-Group-1968939787: creating Nov 06 21:19:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-436acc9a-0ddd-47be-8686-7646f8cb2cd3 tempest-GroupsV320Test-1321850177 None] Group tempest-GroupsV320Test-Group-1968939787: created successfully Nov 06 21:19:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-436acc9a-0ddd-47be-8686-7646f8cb2cd3 tempest-GroupsV320Test-1321850177 None] Create group completed successfully. Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Flow 'volume_create_manager' (bd761ec8-e612-42e6-b2ce-f2b8d7be7730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df4a894-038e-4aa0-817b-36ceb4decd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df4a894-038e-4aa0-817b-36ceb4decd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988108663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5dfc008-9b3c-454e-961c-f63171411eb9,host='devstack@QuobyteHD#QuobyteHD',id=277b7b4b-66c0-49cb-ba0e-db2b9da578b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59e4428c705421e8a13f89745776e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:31Z,use_quota=True,user_id='2298f4253c874a7ca5174d73c58d4e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd469808-d671-4f1a-aba2-e86a91e50eb7),volume_type_id=fd469808-d671-4f1a-aba2-e86a91e50eb7)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28783f-4cc1-407d-973b-a5d6c38ff418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28783f-4cc1-407d-973b-a5d6c38ff418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debb63b7-6dd3-457c-afaf-5dcd45e46978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debb63b7-6dd3-457c-afaf-5dcd45e46978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277b7b4b-66c0-49cb-ba0e-db2b9da578b0', 'volume_name': 'volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12aa52f-f75c-4ad2-949c-9611848f9890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12aa52f-f75c-4ad2-949c-9611848f9890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2cd940-2cb5-45c8-a108-721feaafd4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Volume 277b7b4b-66c0-49cb-ba0e-db2b9da578b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0', 'volume_size': 1} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5dfc008-9b3c-454e-961c-f63171411eb9,created_at=2026-11-06T20:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1988108663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5dfc008-9b3c-454e-961c-f63171411eb9,host='devstack@QuobyteHD#QuobyteHD',id=277b7b4b-66c0-49cb-ba0e-db2b9da578b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59e4428c705421e8a13f89745776e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:31Z,use_quota=True,user_id='2298f4253c874a7ca5174d73c58d4e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd469808-d671-4f1a-aba2-e86a91e50eb7),volume_type_id=fd469808-d671-4f1a-aba2-e86a91e50eb7)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Creating volume 277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:31 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 1073741824 Nov 06 21:19:31 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:31 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 1073741824" returned: 0 in 0.472s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:32 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 Nov 06 21:19:32 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:32 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" returned: 0 in 0.304s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2cd940-2cb5-45c8-a108-721feaafd4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3928b1-f123-449f-aaa4-a6b9cc7195b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Volume volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 (277b7b4b-66c0-49cb-ba0e-db2b9da578b0): created successfully Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3928b1-f123-449f-aaa4-a6b9cc7195b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Flow 'volume_create_manager' (bd761ec8-e612-42e6-b2ce-f2b8d7be7730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ccb7b12a-b1e1-4d4f-b132-5722c323a39d tempest-GroupSnapshotsV319Test-1480150306 None] Created volume successfully. Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Created reservations ['0d41c315-bf1f-4d8d-9036-b0871f82cb76'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:32 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:32 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] GroupSnapshot 2ab498f3-331c-4ede-950b-7859c989fc59: creating. Nov 06 21:19:32 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.300s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c18e8bf6-30b5-4b42-b04a-e519bd42df03 tempest-GroupsV320Test-1321850177 None] Delete group completed successfully. Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Group snapshot 2ab498f3-331c-4ede-950b-7859c989fc59: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Creating offline snapshot 37243bf5-98bc-450a-889d-e96e2675cc4d of volume 277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc7e3d-e839-4135-b158-606e605e0bdc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 Nov 06 21:19:33 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:33 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" returned: 0 in 0.372s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d 1G Nov 06 21:19:33 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:33 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d 1G" returned: 0 in 0.458s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d Nov 06 21:19:33 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d" returned: 0 in 0.365s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:34 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d Nov 06 21:19:34 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:34 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info Nov 06 21:19:34 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info" returned: 0 in 0.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:34 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info Nov 06 21:19:34 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:35 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.info" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6c2ac0bf-48ec-4b51-9078-8d2c637c8dee tempest-GroupSnapshotsV319Test-1480150306 None] group_snapshot 2ab498f3-331c-4ede-950b-7859c989fc59: created successfully Nov 06 21:19:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] group_snapshot 2ab498f3-331c-4ede-950b-7859c989fc59: deleting Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] group_snapshot 2ab498f3-331c-4ede-950b-7859c989fc59: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "cinder-quobyte-37243bf5-98bc-450a-889d-e96e2675cc4d" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-37243bf5-98bc-450a-889d-e96e2675cc4d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Deleting offline snapshot 37243bf5-98bc-450a-889d-e96e2675cc4d of volume 277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] snapshot_file for this snap is: volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f103f5f-7529-4d97-ae6f-b67496005199]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:37 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d Nov 06 21:19:37 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:37 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d" returned: 0 in 0.452s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01231e5-f257-4747-84ed-cef4397bc215]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:37 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 Nov 06 21:19:37 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:38 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:38 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:38 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" returned: 0 in 0.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:38 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d Nov 06 21:19:38 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:38 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.419s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:19:38 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:38 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d Nov 06 21:19:38 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:39 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0.37243bf5-98bc-450a-889d-e96e2675cc4d" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-37243bf5-98bc-450a-889d-e96e2675cc4d" released by "_delete_snapshot" :: held 1.840s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" released by "delete_snapshot" :: held 1.875s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:39 devstack cinder-volume[87230]: WARNING cinder.quota [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-560840578 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-560840578, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:39 devstack cinder-volume[87230]: WARNING cinder.quota [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-560840578 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-560840578, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] Created reservations ['a635fd08-677f-44e8-a79f-ce89fb9e0e7d', 'aefff785-b27a-40c7-b72e-21dbe0735c80', 'fd07e960-336c-4e86-8cd7-099c8b98abf2', 'baddc52d-e674-498b-88ed-36ca88c84f27'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b9ba4af2-449e-41c4-bd94-8354de36adb0 tempest-GroupSnapshotsV319Test-1480150306 None] group_snapshot 2ab498f3-331c-4ede-950b-7859c989fc59: deleted successfully Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3262fa45-c01c-4206-8acf-817d01469c0f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:40 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 Nov 06 21:19:40 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:40 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" returned: 0 in 0.485s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:40 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0 Nov 06 21:19:40 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:41 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" returned: 0 in 0.318s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "cinder-quobyte-277b7b4b-66c0-49cb-ba0e-db2b9da578b0" released by "delete_volume" :: held 0.916s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Created reservations ['7a03a346-dc1e-42e1-93ff-c99b45d7cbae'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:41 devstack cinder-volume[87230]: WARNING cinder.quota [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-560840578 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-560840578, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Created reservations ['5ce266f7-b92e-4b17-aeef-f5e374294412', '5fb9fd56-e2bc-408d-8912-a0110b83c54c', 'ba296ebf-3500-46fa-929b-2d340f6f06d3', 'bb99f53a-3715-4a4e-9b1e-9d25a01910b8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:41 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:41 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-101a44b7-b2cc-4335-9345-5849a304d754 req-4225e09d-ad82-4052-aaf2-a025ad493fff tempest-ServerActionsTestOtherA-916861973 None] Terminate volume connection completed successfully. Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-101a44b7-b2cc-4335-9345-5849a304d754 req-4225e09d-ad82-4052-aaf2-a025ad493fff tempest-ServerActionsTestOtherA-916861973 None] Deleting attachment 305d1249-3fca-4ac9-904f-a494fe7ecf4f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:19:41 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.428s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "cinder-1d55ed49-2a0a-4292-bb66-9f0f1287483c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5f758db2-3d70-4789-b9a4-5c1e12e429a9 tempest-GroupSnapshotsV319Test-1480150306 None] Delete group completed successfully. Nov 06 21:19:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-1d55ed49-2a0a-4292-bb66-9f0f1287483c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "cinder-quobyte-1d55ed49-2a0a-4292-bb66-9f0f1287483c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-quobyte-1d55ed49-2a0a-4292-bb66-9f0f1287483c" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbecad9f-ca8a-44de-bb74-758e927167cc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:42 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c Nov 06 21:19:42 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:42 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c" returned: 0 in 0.650s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:42 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c Nov 06 21:19:42 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:43 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d55ed49-2a0a-4292-bb66-9f0f1287483c" returned: 0 in 0.353s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-quobyte-1d55ed49-2a0a-4292-bb66-9f0f1287483c" released by "delete_volume" :: held 1.099s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.quota [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Created reservations ['81470897-1b97-4191-bd6e-37aec4b9a769', '2846cd28-06f8-4493-89e9-1425a9e4faed', 'e4f25151-cedf-4c81-8fb6-fa85d0689a96', '30266cdb-54d5-445f-a809-d0571b751850'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "cinder-a140f482-ee40-4250-860f-5205a2d9cb19-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-a140f482-ee40-4250-860f-5205a2d9cb19-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "cinder-quobyte-a140f482-ee40-4250-860f-5205a2d9cb19" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-quobyte-a140f482-ee40-4250-860f-5205a2d9cb19" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b92e13-be14-4d7e-9b70-98c16508faa1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:43 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:43 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:43 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 Nov 06 21:19:43 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:43 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.347s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.manager [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Deleted volume successfully. Nov 06 21:19:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-101a44b7-b2cc-4335-9345-5849a304d754 req-a6ecfd14-057c-41e5-a949-ec1de704342f tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-1d55ed49-2a0a-4292-bb66-9f0f1287483c-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:44 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19" returned: 0 in 0.516s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:44 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19 Nov 06 21:19:44 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:44 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a140f482-ee40-4250-860f-5205a2d9cb19" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-quobyte-a140f482-ee40-4250-860f-5205a2d9cb19" released by "delete_volume" :: held 0.893s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Created reservations ['bb49b331-fa79-47dc-9f71-ddd6de8f8af7', 'e3525e5e-9843-4ebf-8244-5df06062ac72', '54d6565f-dfb8-425b-9b42-c89bdb4fd5cf', '556a6b71-715c-4536-aec1-366553d2a2be'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:44 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:19:44 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:44 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Deleted volume successfully. Nov 06 21:19:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a7d751cc-86e8-4932-9fdc-161baa06fcec tempest-ServerActionsTestOtherA-916861973 None] Lock "cinder-a140f482-ee40-4250-860f-5205a2d9cb19-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (c4774242-ebc2-4e1e-ab2e-d66f3872cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7209405c-2e47-42fd-95bf-0ba646ce935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7209405c-2e47-42fd-95bf-0ba646ce935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1975565806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a746c00-c60a-4cc1-8f44-96323bc4f459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:48Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d2f3c1-3eda-4302-9679-66192edb93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d2f3c1-3eda-4302-9679-66192edb93af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe2ae3-0f82-4fd4-a46c-911e73ee7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe2ae3-0f82-4fd4-a46c-911e73ee7045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a746c00-c60a-4cc1-8f44-96323bc4f459', 'volume_name': 'volume-0a746c00-c60a-4cc1-8f44-96323bc4f459', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bf09c7-61fb-414a-aca2-fc0a9c1ad0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bf09c7-61fb-414a-aca2-fc0a9c1ad0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbce33f-83f6-4b38-85b9-19e8b2a17d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Volume 0a746c00-c60a-4cc1-8f44-96323bc4f459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a746c00-c60a-4cc1-8f44-96323bc4f459', 'volume_size': 1} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1975565806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a746c00-c60a-4cc1-8f44-96323bc4f459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:48Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Creating volume 0a746c00-c60a-4cc1-8f44-96323bc4f459 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:48 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:48 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 1073741824 Nov 06 21:19:48 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:48 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 1073741824" returned: 0 in 0.552s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:48 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 Nov 06 21:19:48 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:49 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459" returned: 0 in 0.353s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbce33f-83f6-4b38-85b9-19e8b2a17d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a746c00-c60a-4cc1-8f44-96323bc4f459', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1852d7d-2f67-4b60-8ec6-cd7cdf114e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Volume volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 (0a746c00-c60a-4cc1-8f44-96323bc4f459): created successfully Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1852d7d-2f67-4b60-8ec6-cd7cdf114e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (c4774242-ebc2-4e1e-ab2e-d66f3872cefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c40bc297-06d7-486a-aa40-9c6e02fb757e tempest-AttachVolumeTestJSON-1992869430 None] Created volume successfully. Nov 06 21:19:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-07725536-7bb6-47e7-8ac2-7065e941228b req-e1c85376-68db-40df-83bd-1bf940490ebe tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-07725536-7bb6-47e7-8ac2-7065e941228b req-e1c85376-68db-40df-83bd-1bf940490ebe tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-07725536-7bb6-47e7-8ac2-7065e941228b req-e1c85376-68db-40df-83bd-1bf940490ebe tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-07725536-7bb6-47e7-8ac2-7065e941228b req-e1c85376-68db-40df-83bd-1bf940490ebe tempest-AttachVolumeTestJSON-1992869430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-0a746c00-c60a-4cc1-8f44-96323bc4f459', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c109b58-f0da-41bb-9030-4b8191293289', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-07725536-7bb6-47e7-8ac2-7065e941228b req-e1c85376-68db-40df-83bd-1bf940490ebe tempest-AttachVolumeTestJSON-1992869430 None] attachment_update completed successfully. Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (7c440709-cd35-4692-a98d-657b09e3b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8075f7-0ca2-46d6-9736-e680d7d27687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8075f7-0ca2-46d6-9736-e680d7d27687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830502368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26269ab5-c51f-4288-a898-c7d100932f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:55Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c28fe47-01d4-4cea-88b9-ede47cf665dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c28fe47-01d4-4cea-88b9-ede47cf665dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d474b047-36c4-4999-bc4a-014e8dd8b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d474b047-36c4-4999-bc4a-014e8dd8b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26269ab5-c51f-4288-a898-c7d100932f94', 'volume_name': 'volume-26269ab5-c51f-4288-a898-c7d100932f94', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc6755c-9150-43a3-95f8-14121d5ec41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc6755c-9150-43a3-95f8-14121d5ec41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b056c1-7411-46d9-89d6-a6841df43f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Volume 26269ab5-c51f-4288-a898-c7d100932f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26269ab5-c51f-4288-a898-c7d100932f94', 'volume_size': 1} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830502368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26269ab5-c51f-4288-a898-c7d100932f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7687e60692b64166823f5572e1230b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:55Z,use_quota=True,user_id='1483431636d1424d9939c9b184e86591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Creating volume 26269ab5-c51f-4288-a898-c7d100932f94 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:54 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:19:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:54 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 1073741824 Nov 06 21:19:54 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:55 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 1073741824" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:55 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 Nov 06 21:19:55 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:56 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b056c1-7411-46d9-89d6-a6841df43f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26269ab5-c51f-4288-a898-c7d100932f94', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c607ae9-81a5-4c9e-8d5b-f1bb9c503b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Volume volume-26269ab5-c51f-4288-a898-c7d100932f94 (26269ab5-c51f-4288-a898-c7d100932f94): created successfully Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c607ae9-81a5-4c9e-8d5b-f1bb9c503b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Flow 'volume_create_manager' (7c440709-cd35-4692-a98d-657b09e3b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-010e9cd4-50f5-4601-af25-c72aefebdf7e tempest-AttachVolumeTestJSON-1992869430 None] Created volume successfully. Nov 06 21:19:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-51ae49c2-1325-46e2-8a06-eaa96c74c7aa req-920260b7-1e2e-45ab-ace1-b1489e291039 tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-51ae49c2-1325-46e2-8a06-eaa96c74c7aa req-920260b7-1e2e-45ab-ace1-b1489e291039 tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-51ae49c2-1325-46e2-8a06-eaa96c74c7aa req-920260b7-1e2e-45ab-ace1-b1489e291039 tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-51ae49c2-1325-46e2-8a06-eaa96c74c7aa req-920260b7-1e2e-45ab-ace1-b1489e291039 tempest-AttachVolumeTestJSON-1992869430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-26269ab5-c51f-4288-a898-c7d100932f94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2859d442-1bd7-489b-9918-0056543c1774', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-51ae49c2-1325-46e2-8a06-eaa96c74c7aa req-920260b7-1e2e-45ab-ace1-b1489e291039 tempest-AttachVolumeTestJSON-1992869430 None] attachment_update completed successfully. Nov 06 21:20:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-cd40e05a-3281-47c8-8851-b33f8fd9d169 req-bc50d0ab-480a-4c5a-8f9e-9d22a5efb3f9 tempest-AttachVolumeTestJSON-1992869430 None] Terminate volume connection completed successfully. Nov 06 21:20:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-cd40e05a-3281-47c8-8851-b33f8fd9d169 req-bc50d0ab-480a-4c5a-8f9e-9d22a5efb3f9 tempest-AttachVolumeTestJSON-1992869430 None] Deleting attachment 7c109b58-f0da-41bb-9030-4b8191293289. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:20:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-0748a7b3-551e-4be8-86f7-c7820389adc8 req-0933b995-2507-416b-8a6b-5937bb6b5d5e tempest-AttachVolumeTestJSON-1992869430 None] Terminate volume connection completed successfully. Nov 06 21:20:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-0748a7b3-551e-4be8-86f7-c7820389adc8 req-0933b995-2507-416b-8a6b-5937bb6b5d5e tempest-AttachVolumeTestJSON-1992869430 None] Deleting attachment 2859d442-1bd7-489b-9918-0056543c1774. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Flow 'volume_create_manager' (2c1d78ec-4751-4842-86ac-c864f074a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26ae170-5a47-43cb-ad85-f6976f609217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26ae170-5a47-43cb-ad85-f6976f609217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1098725402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad970d9-983b-4222-89d4-671fd7e63672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58d5fc01284704858a6dce695f0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:03Z,use_quota=True,user_id='e85fdfaf58f841e3b709567f3f1bd362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7b90fd-5e7b-412d-a7ab-341ae58e9e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7b90fd-5e7b-412d-a7ab-341ae58e9e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e38286b-36ca-4da5-b93e-857326a11b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e38286b-36ca-4da5-b93e-857326a11b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad970d9-983b-4222-89d4-671fd7e63672', 'volume_name': 'volume-2ad970d9-983b-4222-89d4-671fd7e63672', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4982f8-3ae3-4b38-8655-43d75feedba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4982f8-3ae3-4b38-8655-43d75feedba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18cc015-6a98-4690-8b57-ffe85de125ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Volume 2ad970d9-983b-4222-89d4-671fd7e63672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad970d9-983b-4222-89d4-671fd7e63672', 'volume_size': 1} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1098725402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad970d9-983b-4222-89d4-671fd7e63672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58d5fc01284704858a6dce695f0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:03Z,use_quota=True,user_id='e85fdfaf58f841e3b709567f3f1bd362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Creating volume 2ad970d9-983b-4222-89d4-671fd7e63672 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 1073741824 Nov 06 21:20:03 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 1073741824" returned: 0 in 0.693s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 Nov 06 21:20:03 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:04 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18cc015-6a98-4690-8b57-ffe85de125ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad970d9-983b-4222-89d4-671fd7e63672', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fbcbd1-5a58-4b1e-ae2a-50166cb097a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Volume volume-2ad970d9-983b-4222-89d4-671fd7e63672 (2ad970d9-983b-4222-89d4-671fd7e63672): created successfully Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fbcbd1-5a58-4b1e-ae2a-50166cb097a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Flow 'volume_create_manager' (2c1d78ec-4751-4842-86ac-c864f074a19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-142f05fc-6c94-4fbb-98c7-e660cd5e7ddd tempest-VolumeQuotasNegativeTestJSON-42932985 None] Created volume successfully. Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Acquiring lock "cinder-2ad970d9-983b-4222-89d4-671fd7e63672-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "cinder-2ad970d9-983b-4222-89d4-671fd7e63672-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Acquiring lock "cinder-quobyte-2ad970d9-983b-4222-89d4-671fd7e63672" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "cinder-quobyte-2ad970d9-983b-4222-89d4-671fd7e63672" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e577f-e169-46d8-978d-763034a26bba]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:07 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 Nov 06 21:20:07 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672" returned: 0 in 0.567s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:07 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672 Nov 06 21:20:07 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:08 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ad970d9-983b-4222-89d4-671fd7e63672" returned: 0 in 0.313s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "cinder-quobyte-2ad970d9-983b-4222-89d4-671fd7e63672" released by "delete_volume" :: held 0.966s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Created reservations ['1731bc4e-ef16-49c5-9222-8e97e28a214f', '5ce8f578-c868-4dc8-931a-74f55db21fe4', '14af658b-16cc-4a4e-88a1-01722d83a256', '652908f0-e58e-4b42-bac6-8d8934de554c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:08 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:08 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:08 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.287s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Deleted volume successfully. Nov 06 21:20:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e502768f-f4e2-4462-a1fe-749278eebf92 tempest-VolumeQuotasNegativeTestJSON-42932985 None] Lock "cinder-2ad970d9-983b-4222-89d4-671fd7e63672-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-26269ab5-c51f-4288-a898-c7d100932f94-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-26269ab5-c51f-4288-a898-c7d100932f94-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-quobyte-26269ab5-c51f-4288-a898-c7d100932f94" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-26269ab5-c51f-4288-a898-c7d100932f94" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a86c3e7-d370-423b-8830-7f1855b3ee3d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 Nov 06 21:20:10 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:11 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94" returned: 0 in 0.454s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:11 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94 Nov 06 21:20:11 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:11 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-26269ab5-c51f-4288-a898-c7d100932f94" returned: 0 in 0.309s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-26269ab5-c51f-4288-a898-c7d100932f94" released by "delete_volume" :: held 0.827s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Created reservations ['a90872d2-540b-46cb-b085-8e0c6aafd63d', '77b5aeae-cce7-4839-a664-7b46286e5897', 'c1c6a395-dd46-4e36-b53c-e70419840a2a', '61cbeaa2-7a25-4079-b3ff-0a966c712829'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:11 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:11 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-0a746c00-c60a-4cc1-8f44-96323bc4f459-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-0a746c00-c60a-4cc1-8f44-96323bc4f459-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-quobyte-0a746c00-c60a-4cc1-8f44-96323bc4f459" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-0a746c00-c60a-4cc1-8f44-96323bc4f459" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf298db-aade-4b58-acbf-51e7c1a1908c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:12 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Deleted volume successfully. Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-accfbc75-9c13-4b97-a72b-fcec1c581f8c tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-26269ab5-c51f-4288-a898-c7d100932f94-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:12 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 Nov 06 21:20:12 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:12 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459" returned: 0 in 0.731s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:12 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459 Nov 06 21:20:12 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:13 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0a746c00-c60a-4cc1-8f44-96323bc4f459" returned: 0 in 0.400s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-0a746c00-c60a-4cc1-8f44-96323bc4f459" released by "delete_volume" :: held 1.219s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Created reservations ['0184738d-2e24-4791-848e-494bc0e19b5d', '565b0186-3d7b-47bf-b8a8-ccccaea02819', 'ec646024-a916-44ce-aee1-4959b6401194', 'c1f17162-d086-4184-a619-c5b77152c57c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:13 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:13 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:13 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Deleted volume successfully. Nov 06 21:20:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-61953df4-ecc5-44e6-aa77-e4511e60c53d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-0a746c00-c60a-4cc1-8f44-96323bc4f459-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-dad0981b-ae1a-4dcf-b365-66f513a3120f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-dad0981b-ae1a-4dcf-b365-66f513a3120f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "cinder-quobyte-dad0981b-ae1a-4dcf-b365-66f513a3120f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-dad0981b-ae1a-4dcf-b365-66f513a3120f" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d4f342-fe40-4348-81d1-83e4f5f5fc60]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:14 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f Nov 06 21:20:14 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:15 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f" returned: 0 in 0.498s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:15 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f Nov 06 21:20:15 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:15 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-dad0981b-ae1a-4dcf-b365-66f513a3120f" returned: 0 in 0.342s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-quobyte-dad0981b-ae1a-4dcf-b365-66f513a3120f" released by "delete_volume" :: held 0.908s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Created reservations ['d0d4a0ab-20b8-4c88-a29a-426b2857ac47', 'b0f2ceb8-b582-4357-b98f-11a917b337c1', '10c0528a-0271-4572-848a-3737c6d8608f', '07689220-65ca-473f-ae72-0ed14ea23dd8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:15 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:15 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:15 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Deleted volume successfully. Nov 06 21:20:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d752148-b9c8-4fe2-8218-ce5277df558d tempest-AttachVolumeTestJSON-1992869430 None] Lock "cinder-dad0981b-ae1a-4dcf-b365-66f513a3120f-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=93,cinder:INSERT=24,cinder:UPDATE=93,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:INSERT=19,cinder:UPDATE=96,cinder:SELECT=80,cinder:DELETE=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Flow 'volume_create_manager' (ea9fc9c8-2ccb-41a3-8595-b41fb271b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f065e442-1baf-4612-ac71-acd8763630f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f065e442-1baf-4612-ac71-acd8763630f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-502588679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726b715b-b72c-4edd-9fde-ee62eb29dfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c705e29f037e4cc299f0f3c16f65ada4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:21Z,use_quota=True,user_id='20e3eade7e7e4a5da93461b1cff69b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1915b303-b64d-45bd-952a-1f513f874366),volume_type_id=1915b303-b64d-45bd-952a-1f513f874366)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da9de5a-eefa-43ea-b3fe-77cf936a4c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da9de5a-eefa-43ea-b3fe-77cf936a4c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad01894d-13d5-4a3e-bbea-806a78c31d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad01894d-13d5-4a3e-bbea-806a78c31d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726b715b-b72c-4edd-9fde-ee62eb29dfcd', 'volume_name': 'volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d9c8d9-fa01-498d-a05b-aaaf75c7e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d9c8d9-fa01-498d-a05b-aaaf75c7e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc2eb11-76e3-4b80-9eb2-6e1e8f17a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Volume 726b715b-b72c-4edd-9fde-ee62eb29dfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd', 'volume_size': 1} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-502588679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726b715b-b72c-4edd-9fde-ee62eb29dfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c705e29f037e4cc299f0f3c16f65ada4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:21Z,use_quota=True,user_id='20e3eade7e7e4a5da93461b1cff69b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1915b303-b64d-45bd-952a-1f513f874366),volume_type_id=1915b303-b64d-45bd-952a-1f513f874366)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Creating volume 726b715b-b72c-4edd-9fde-ee62eb29dfcd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:21 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:21 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd 1073741824 Nov 06 21:20:21 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:21 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd 1073741824" returned: 0 in 0.566s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:21 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd Nov 06 21:20:21 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:22 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc2eb11-76e3-4b80-9eb2-6e1e8f17a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6816db4c-e77b-4643-a140-0b66cb6d4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Volume volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd (726b715b-b72c-4edd-9fde-ee62eb29dfcd): created successfully Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6816db4c-e77b-4643-a140-0b66cb6d4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Flow 'volume_create_manager' (ea9fc9c8-2ccb-41a3-8595-b41fb271b22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b8c8c2b7-8c29-4bc3-bf1d-8f0e12e173e2 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Created volume successfully. Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:24 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:24 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:24 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-efb75fee-5db1-41aa-b076-e7776a81c56d tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Retype volume completed successfully. Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "cinder-726b715b-b72c-4edd-9fde-ee62eb29dfcd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "cinder-726b715b-b72c-4edd-9fde-ee62eb29dfcd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "cinder-quobyte-726b715b-b72c-4edd-9fde-ee62eb29dfcd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "cinder-quobyte-726b715b-b72c-4edd-9fde-ee62eb29dfcd" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bafb083-b70c-4d9c-a6c4-b98fdcbbf87a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:26 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd Nov 06 21:20:26 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:27 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd" returned: 0 in 1.026s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:27 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd Nov 06 21:20:27 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:28 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-726b715b-b72c-4edd-9fde-ee62eb29dfcd" returned: 0 in 0.567s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "cinder-quobyte-726b715b-b72c-4edd-9fde-ee62eb29dfcd" released by "delete_volume" :: held 1.675s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:28 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:28 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Created reservations ['7f5f1f76-acaf-4315-aded-01ad9c2b82a7', 'b9305c81-7b5c-4456-9935-32a81e5cb8e9', 'b3dfd6aa-4bd4-4cee-9d4c-873e86bb504d', 'fec073b3-eb75-4e2b-ae96-b6f4e494394b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:28 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:28 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:28 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Deleted volume successfully. Nov 06 21:20:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d073c06d-6f15-4e93-aff7-74bbd3234ec8 tempest-VolumeRetypeWithoutMigrationTest-692568651 None] Lock "cinder-726b715b-b72c-4edd-9fde-ee62eb29dfcd-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Flow 'volume_create_manager' (da4ef2dc-5b81-4cdf-bf38-053201e3a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3267b5e4-d644-46d1-a835-a2e608b0e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3267b5e4-d644-46d1-a835-a2e608b0e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-378692642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97be447-51ec-4aca-a341-ab4b0533970b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42902b19ea7c4792a4b1f45c180ea0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:30Z,use_quota=True,user_id='df6dbefb1cc94951979e8cdad06dd518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f27deb-2129-4cfa-a16d-2b4769fd6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f27deb-2129-4cfa-a16d-2b4769fd6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da45bfc7-59a0-428d-a0c9-f00baa5763b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da45bfc7-59a0-428d-a0c9-f00baa5763b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97be447-51ec-4aca-a341-ab4b0533970b', 'volume_name': 'volume-e97be447-51ec-4aca-a341-ab4b0533970b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c6db1d-24b5-4155-bc29-a0b30b80bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c6db1d-24b5-4155-bc29-a0b30b80bd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db87f08c-0747-42fb-82b7-91549602aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Volume e97be447-51ec-4aca-a341-ab4b0533970b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97be447-51ec-4aca-a341-ab4b0533970b', 'volume_size': 1} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-378692642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97be447-51ec-4aca-a341-ab4b0533970b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42902b19ea7c4792a4b1f45c180ea0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:30Z,use_quota=True,user_id='df6dbefb1cc94951979e8cdad06dd518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Creating volume e97be447-51ec-4aca-a341-ab4b0533970b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:30 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b 1073741824 Nov 06 21:20:30 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:31 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b 1073741824" returned: 0 in 0.954s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:31 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b Nov 06 21:20:31 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:32 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b" returned: 0 in 0.635s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db87f08c-0747-42fb-82b7-91549602aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97be447-51ec-4aca-a341-ab4b0533970b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a0fe6b-6d77-4edf-af1b-7456f63b67d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Volume volume-e97be447-51ec-4aca-a341-ab4b0533970b (e97be447-51ec-4aca-a341-ab4b0533970b): created successfully Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a0fe6b-6d77-4edf-af1b-7456f63b67d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Flow 'volume_create_manager' (da4ef2dc-5b81-4cdf-bf38-053201e3a8df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4d58d50a-96f2-43f4-9d5c-a8e38e6d26af req-3e20c1e3-cc77-4441-82c4-1135c82a8801 tempest-VolumesGetTestJSON-100787910 None] Created volume successfully. Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Acquiring lock "cinder-e97be447-51ec-4aca-a341-ab4b0533970b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "cinder-e97be447-51ec-4aca-a341-ab4b0533970b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Acquiring lock "cinder-quobyte-e97be447-51ec-4aca-a341-ab4b0533970b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "cinder-quobyte-e97be447-51ec-4aca-a341-ab4b0533970b" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c512fa29-a8bb-44a5-8bdb-70ecbdb23f3d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:34 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b Nov 06 21:20:34 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:34 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:34 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b Nov 06 21:20:34 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:35 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e97be447-51ec-4aca-a341-ab4b0533970b" returned: 0 in 0.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "cinder-quobyte-e97be447-51ec-4aca-a341-ab4b0533970b" released by "delete_volume" :: held 1.214s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG cinder.quota [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Created reservations ['fd76122d-f374-4871-bcfb-78c0ad738147', 'f8eaacf5-6023-4501-8102-7459f5bd1107', '4349cd66-1ec2-4191-a0d0-e633b8b844d2', '36173e45-0dde-4272-a54b-4e8f74b9bcdb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:35 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:35 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:36 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.562s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:36 devstack cinder-volume[87230]: DEBUG cinder.manager [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Deleted volume successfully. Nov 06 21:20:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-408aea6d-b679-4e8a-ab91-c237a23a3ac3 req-6ec1a899-4697-442f-aeae-1fa9874887f0 tempest-VolumesGetTestJSON-100787910 None] Lock "cinder-e97be447-51ec-4aca-a341-ab4b0533970b-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:38 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:38 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:38 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.624s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:20:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Flow 'volume_create_manager' (4300a4f2-f333-4536-8141-4a0fa0522358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8718899e-2bfc-4899-a614-974771bcf54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8718899e-2bfc-4899-a614-974771bcf54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1236235322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8137033-867f-4077-9fab-9ce88a1e7436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099509e19a184183a16f57ea1d1d643f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:45Z,use_quota=True,user_id='fbc04ad91f494d54be848ea9908f66ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5d3280-2a2f-445f-ab29-9d7033257104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5d3280-2a2f-445f-ab29-9d7033257104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56c7fb-5699-4573-a514-4694105e8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56c7fb-5699-4573-a514-4694105e8721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8137033-867f-4077-9fab-9ce88a1e7436', 'volume_name': 'volume-f8137033-867f-4077-9fab-9ce88a1e7436', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb291f3-3b1a-4eff-9db7-9586773d0b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb291f3-3b1a-4eff-9db7-9586773d0b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0b3141-eea6-4e8a-af0d-eb93883f428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Volume f8137033-867f-4077-9fab-9ce88a1e7436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8137033-867f-4077-9fab-9ce88a1e7436', 'volume_size': 1} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1236235322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8137033-867f-4077-9fab-9ce88a1e7436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099509e19a184183a16f57ea1d1d643f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:45Z,use_quota=True,user_id='fbc04ad91f494d54be848ea9908f66ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Creating volume f8137033-867f-4077-9fab-9ce88a1e7436 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 1073741824 Nov 06 21:20:45 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Flow 'volume_create_manager' (15caf065-df8e-400e-9c0d-68391baf3146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e7ec4-5d7e-4312-946d-5b650cf55266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966e7ec4-5d7e-4312-946d-5b650cf55266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1846214425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9610cd92-a69b-4be7-b509-95518ee5abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8a0701516b4ece9d99017fd8ffadd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:46Z,use_quota=True,user_id='3b338e3838ce402db09cfc56c827e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b7761-4af6-4180-b5ba-ab498fecfc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b7761-4af6-4180-b5ba-ab498fecfc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3490341e-4149-4bfb-bbe9-17a03aab2a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3490341e-4149-4bfb-bbe9-17a03aab2a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9610cd92-a69b-4be7-b509-95518ee5abe8', 'volume_name': 'volume-9610cd92-a69b-4be7-b509-95518ee5abe8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c9d004-fa62-4794-ae90-90511942b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c9d004-fa62-4794-ae90-90511942b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cd3351-dd32-4f8b-a0c2-523d6bb8d6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Volume 9610cd92-a69b-4be7-b509-95518ee5abe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9610cd92-a69b-4be7-b509-95518ee5abe8', 'volume_size': 1} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:45 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 1073741824" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 Nov 06 21:20:45 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436" returned: 0 in 0.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1846214425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9610cd92-a69b-4be7-b509-95518ee5abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8a0701516b4ece9d99017fd8ffadd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:46Z,use_quota=True,user_id='3b338e3838ce402db09cfc56c827e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Creating volume 9610cd92-a69b-4be7-b509-95518ee5abe8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0b3141-eea6-4e8a-af0d-eb93883f428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8137033-867f-4077-9fab-9ce88a1e7436', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7f4995-9d01-4de2-a558-068e1d0b78aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Volume volume-f8137033-867f-4077-9fab-9ce88a1e7436 (f8137033-867f-4077-9fab-9ce88a1e7436): created successfully Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7f4995-9d01-4de2-a558-068e1d0b78aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Flow 'volume_create_manager' (4300a4f2-f333-4536-8141-4a0fa0522358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:46 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 1073741824 Nov 06 21:20:46 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-089c6be7-b25a-46f2-b223-3be2118389cb tempest-ServersNegativeTestJSON-219183287 None] Created volume successfully. Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e503ad98-193f-46b7-86f8-2f9af4071508 tempest-GroupsTest-2003584088 None] Group tempest-Group1-1477219016: creating Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e503ad98-193f-46b7-86f8-2f9af4071508 tempest-GroupsTest-2003584088 None] Group tempest-Group1-1477219016: created successfully Nov 06 21:20:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e503ad98-193f-46b7-86f8-2f9af4071508 tempest-GroupsTest-2003584088 None] Create group completed successfully. Nov 06 21:20:47 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 1073741824" returned: 0 in 0.681s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 Nov 06 21:20:47 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:47 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8" returned: 0 in 0.446s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cd3351-dd32-4f8b-a0c2-523d6bb8d6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9610cd92-a69b-4be7-b509-95518ee5abe8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd9bf5c-069f-44d2-9671-d6b5dbaeff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:47 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Volume volume-9610cd92-a69b-4be7-b509-95518ee5abe8 (9610cd92-a69b-4be7-b509-95518ee5abe8): created successfully Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd9bf5c-069f-44d2-9671-d6b5dbaeff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:47 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Flow 'volume_create_manager' (15caf065-df8e-400e-9c0d-68391baf3146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-55fa5e46-4e48-4ae2-a019-c279099bdd2f tempest-VolumesServicesTestJSON-108904659 None] Created volume successfully. Nov 06 21:20:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-530e10ef-59e4-4ed5-ab13-3235a513bdde tempest-GroupsTest-2003584088 None] Group tempest-Group2-1055187815: creating Nov 06 21:20:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-530e10ef-59e4-4ed5-ab13-3235a513bdde tempest-GroupsTest-2003584088 None] Group tempest-Group2-1055187815: created successfully Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Acquiring lock "cinder-9610cd92-a69b-4be7-b509-95518ee5abe8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-530e10ef-59e4-4ed5-ab13-3235a513bdde tempest-GroupsTest-2003584088 None] Create group completed successfully. Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "cinder-9610cd92-a69b-4be7-b509-95518ee5abe8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Acquiring lock "cinder-quobyte-9610cd92-a69b-4be7-b509-95518ee5abe8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "cinder-quobyte-9610cd92-a69b-4be7-b509-95518ee5abe8" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405b280-a875-405a-b24b-6a4d6ec8fd09]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:48 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 Nov 06 21:20:48 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:48 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8 Nov 06 21:20:48 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Flow 'volume_create_manager' (9b40a1dd-f015-45f6-94f4-e067461c3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194c8ee0-2c8c-4e11-8ff9-c1f8caa5d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194c8ee0-2c8c-4e11-8ff9-c1f8caa5d466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1447210086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a99d687-4b91-400d-ac0a-dc5581f04c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099509e19a184183a16f57ea1d1d643f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:49Z,use_quota=True,user_id='fbc04ad91f494d54be848ea9908f66ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b245f-cb53-415b-9a9c-c78b21d3f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b245f-cb53-415b-9a9c-c78b21d3f65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca4d9b7-7855-45b7-941e-5fb0efddca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca4d9b7-7855-45b7-941e-5fb0efddca59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a99d687-4b91-400d-ac0a-dc5581f04c4c', 'volume_name': 'volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764861b0-b8a9-442c-bca7-16ee0a19b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764861b0-b8a9-442c-bca7-16ee0a19b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0f49a3-c14b-47c8-84a3-0679b8f6803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Volume 8a99d687-4b91-400d-ac0a-dc5581f04c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c', 'volume_size': 1} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1447210086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a99d687-4b91-400d-ac0a-dc5581f04c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099509e19a184183a16f57ea1d1d643f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:49Z,use_quota=True,user_id='fbc04ad91f494d54be848ea9908f66ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Creating volume 8a99d687-4b91-400d-ac0a-dc5581f04c4c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:49 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:49 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9610cd92-a69b-4be7-b509-95518ee5abe8" returned: 0 in 0.346s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:49 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c 1073741824 Nov 06 21:20:49 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "cinder-quobyte-9610cd92-a69b-4be7-b509-95518ee5abe8" released by "delete_volume" :: held 0.880s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Created reservations ['3d9ab437-eafb-4e96-9862-215cc3550d37', 'c7fa6dfe-d0e4-4c05-b6b5-00283f5a99e0', 'cbde5466-ae7e-4f23-8c62-6a056f93772d', '3803f830-a9af-4e91-9945-e6a66b60a4fb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:49 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:49 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:49 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Deleted volume successfully. Nov 06 21:20:49 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91129bda-b69c-4979-bd35-8b807a2f4c39 tempest-VolumesServicesTestJSON-108904659 None] Lock "cinder-9610cd92-a69b-4be7-b509-95518ee5abe8-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c 1073741824" returned: 0 in 0.738s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:49 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c Nov 06 21:20:49 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:50 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0f49a3-c14b-47c8-84a3-0679b8f6803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab799d-a152-4688-98c9-44d17be26ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Volume volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c (8a99d687-4b91-400d-ac0a-dc5581f04c4c): created successfully Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab799d-a152-4688-98c9-44d17be26ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Flow 'volume_create_manager' (9b40a1dd-f015-45f6-94f4-e067461c3d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a32dbfcd-6b60-4d62-92dd-425e410bce25 tempest-ServersNegativeTestJSON-219183287 None] Created volume successfully. Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (feb19d9a-7269-4e3d-800e-b856167205d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de3973-d2ad-4b1f-9e3b-1ed2607b6abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de3973-d2ad-4b1f-9e3b-1ed2607b6abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556133891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=136e1490-f7bd-494a-be6f-715dfb6505b4,host='devstack@QuobyteHD#QuobyteHD',id=6673cdbe-5113-4c04-8145-f033f94b9b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:50Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d13dd6e6-9693-4e4b-ab56-0b5786d69ae0),volume_type_id=d13dd6e6-9693-4e4b-ab56-0b5786d69ae0)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5d2bf-b5c1-4166-a9a6-f3a66de3c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5d2bf-b5c1-4166-a9a6-f3a66de3c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85be15f7-a3a3-4337-9d0c-aab41c58887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85be15f7-a3a3-4337-9d0c-aab41c58887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6673cdbe-5113-4c04-8145-f033f94b9b14', 'volume_name': 'volume-6673cdbe-5113-4c04-8145-f033f94b9b14', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b9d21-08b2-4f2d-835b-a316181c20ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b9d21-08b2-4f2d-835b-a316181c20ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed6641-21c0-4e19-8f61-51fcbfa2207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Volume 6673cdbe-5113-4c04-8145-f033f94b9b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6673cdbe-5113-4c04-8145-f033f94b9b14', 'volume_size': 1} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=136e1490-f7bd-494a-be6f-715dfb6505b4,created_at=2026-11-06T20:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556133891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=136e1490-f7bd-494a-be6f-715dfb6505b4,host='devstack@QuobyteHD#QuobyteHD',id=6673cdbe-5113-4c04-8145-f033f94b9b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:50Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d13dd6e6-9693-4e4b-ab56-0b5786d69ae0),volume_type_id=d13dd6e6-9693-4e4b-ab56-0b5786d69ae0)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Creating volume 6673cdbe-5113-4c04-8145-f033f94b9b14 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:50 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 1073741824 Nov 06 21:20:50 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:51 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 1073741824" returned: 0 in 0.647s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:51 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 Nov 06 21:20:51 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:51 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed6641-21c0-4e19-8f61-51fcbfa2207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6673cdbe-5113-4c04-8145-f033f94b9b14', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4377c7c-b569-445a-a265-4d21898695b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Volume volume-6673cdbe-5113-4c04-8145-f033f94b9b14 (6673cdbe-5113-4c04-8145-f033f94b9b14): created successfully Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4377c7c-b569-445a-a265-4d21898695b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (feb19d9a-7269-4e3d-800e-b856167205d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9d71b07f-415a-46cf-96f5-8a1f1abd09e9 tempest-GroupsTest-2003584088 None] Created volume successfully. Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "cinder-8a99d687-4b91-400d-ac0a-dc5581f04c4c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-8a99d687-4b91-400d-ac0a-dc5581f04c4c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "cinder-quobyte-8a99d687-4b91-400d-ac0a-dc5581f04c4c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-quobyte-8a99d687-4b91-400d-ac0a-dc5581f04c4c" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefcea3-7ac0-424f-88f6-34d9389ac43e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:52 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c Nov 06 21:20:52 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:53 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c" returned: 0 in 0.563s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:53 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c Nov 06 21:20:53 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:53 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8a99d687-4b91-400d-ac0a-dc5581f04c4c" returned: 0 in 0.356s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-quobyte-8a99d687-4b91-400d-ac0a-dc5581f04c4c" released by "delete_volume" :: held 0.981s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Created reservations ['79a59084-a42f-4d43-ba21-222cf40db184', '8617ace1-a2df-49c2-9f88-b639ee576609', '34ccdf81-04e4-4aa6-a5b9-a9b76cd31e37', 'd2a865a1-9550-46ba-b78b-ae41cfc6dd62'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:53 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:53 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:54 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Deleted volume successfully. Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55cd198e-ba09-4197-a0b6-88482a13b66c tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-8a99d687-4b91-400d-ac0a-dc5581f04c4c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Acquiring lock "cinder-quobyte-6673cdbe-5113-4c04-8145-f033f94b9b14" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-6673cdbe-5113-4c04-8145-f033f94b9b14" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[984dc85d-ce47-40a9-b014-fca4156c5743]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:54 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 Nov 06 21:20:54 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:54 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14" returned: 0 in 0.429s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:54 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14 Nov 06 21:20:54 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "cinder-f8137033-867f-4077-9fab-9ce88a1e7436-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-f8137033-867f-4077-9fab-9ce88a1e7436-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "cinder-quobyte-f8137033-867f-4077-9fab-9ce88a1e7436" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-quobyte-f8137033-867f-4077-9fab-9ce88a1e7436" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c68974-6a65-480a-ab1e-6f6cd2b3dfac]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:54 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6673cdbe-5113-4c04-8145-f033f94b9b14" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-6673cdbe-5113-4c04-8145-f033f94b9b14" released by "delete_volume" :: held 0.870s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:55 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 Nov 06 21:20:55 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Created reservations ['28ed6a22-c7fa-4b65-950c-0bac416c8083'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:55 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1338604489 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1338604489, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:55 devstack cinder-volume[87230]: WARNING cinder.quota [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1338604489 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1338604489, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Created reservations ['3a7b8c63-8fca-47cd-a154-b439ad891a73', '92c2bd89-1537-4b7c-8f58-ebc90309cc2b', '52b388fd-6726-4560-9bc3-6249399f4aa0', 'e8ffb753-601b-4321-beb6-66b99efca069'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:55 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:55 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436" returned: 0 in 0.676s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:55 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436 Nov 06 21:20:55 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.510s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Created reservations ['9f40e817-7fbd-402c-a22a-bd49b95ee89f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:55 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d6ccb8f2-3f5f-4fe0-b212-e0fc63c659bc tempest-GroupsTest-2003584088 None] Delete group completed successfully. Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f8137033-867f-4077-9fab-9ce88a1e7436" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-quobyte-f8137033-867f-4077-9fab-9ce88a1e7436" released by "delete_volume" :: held 1.077s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:56 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:56 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Created reservations ['7428a1e0-e7a7-4490-b931-fef29edc9dee', 'c420f10b-ba02-41cf-a0bb-4d12c9a408d9', 'cf5f6a9f-9ffa-417c-b45b-762d1d34cd81', 'd681c79b-4978-419f-915c-e550ae07b3d4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:56 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:20:56 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:56 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-16425648-0910-4209-aae9-026fd88c3da2 tempest-GroupsTest-2003584088 None] Delete group completed successfully. Nov 06 21:20:56 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Deleted volume successfully. Nov 06 21:20:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4fd95e33-c61f-49d6-82e2-74256ac90e84 tempest-ServersNegativeTestJSON-219183287 None] Lock "cinder-f8137033-867f-4077-9fab-9ce88a1e7436-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2f7d9060-6294-4b09-a2a2-d90aa7c77488 tempest-GroupsTest-2003584088 None] Group tempest-GroupsTest-Group-1777904698: creating Nov 06 21:20:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2f7d9060-6294-4b09-a2a2-d90aa7c77488 tempest-GroupsTest-2003584088 None] Group tempest-GroupsTest-Group-1777904698: created successfully Nov 06 21:20:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2f7d9060-6294-4b09-a2a2-d90aa7c77488 tempest-GroupsTest-2003584088 None] Create group completed successfully. Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (8f7f8228-42ef-40a2-aa9a-3d42e10b453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8a15cc-6ed4-46dd-b10c-31a28d709361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8a15cc-6ed4-46dd-b10c-31a28d709361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-617882861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,host='devstack@QuobyteHD#QuobyteHD',id=ac4ddc39-d942-41ee-933f-24c0cfc431e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:00Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536b9928-8427-447d-ba21-8378a4f91f49),volume_type_id=536b9928-8427-447d-ba21-8378a4f91f49)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60137204-3f87-4704-b09a-c68c8098cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60137204-3f87-4704-b09a-c68c8098cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38398b45-0529-4096-b1c0-daf665690dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38398b45-0529-4096-b1c0-daf665690dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4ddc39-d942-41ee-933f-24c0cfc431e3', 'volume_name': 'volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070399c5-c29f-4ae2-85e9-371151d01a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070399c5-c29f-4ae2-85e9-371151d01a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bdf40d2-a1c8-435c-86fe-35ee84edf248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Volume ac4ddc39-d942-41ee-933f-24c0cfc431e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3', 'volume_size': 1} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,created_at=2026-11-06T20:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-617882861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,host='devstack@QuobyteHD#QuobyteHD',id=ac4ddc39-d942-41ee-933f-24c0cfc431e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:00Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536b9928-8427-447d-ba21-8378a4f91f49),volume_type_id=536b9928-8427-447d-ba21-8378a4f91f49)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Creating volume ac4ddc39-d942-41ee-933f-24c0cfc431e3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:20:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:59 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 1073741824 Nov 06 21:20:59 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:00 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 1073741824" returned: 0 in 0.576s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:00 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 Nov 06 21:21:00 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:00 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3" returned: 0 in 0.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bdf40d2-a1c8-435c-86fe-35ee84edf248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4639fa13-10dd-48c2-a519-c05e06fb1625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Volume volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 (ac4ddc39-d942-41ee-933f-24c0cfc431e3): created successfully Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4639fa13-10dd-48c2-a519-c05e06fb1625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (8f7f8228-42ef-40a2-aa9a-3d42e10b453f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c0f4b6aa-5a13-4b49-9db3-70536e46541a tempest-GroupsTest-2003584088 None] Created volume successfully. Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (c7988ef8-b596-4352-ae55-5c9576cf5802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24f29b7-5b46-45f1-99e0-d66c79b8dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24f29b7-5b46-45f1-99e0-d66c79b8dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941524921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,host='devstack@QuobyteHD#QuobyteHD',id=84d939b7-d86c-4008-9018-3da6fa08e3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:03Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536b9928-8427-447d-ba21-8378a4f91f49),volume_type_id=536b9928-8427-447d-ba21-8378a4f91f49)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7657825-31f5-46b7-932f-3efeb57001df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7657825-31f5-46b7-932f-3efeb57001df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3123e661-4310-443e-8fe8-bc9df1263df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3123e661-4310-443e-8fe8-bc9df1263df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d939b7-d86c-4008-9018-3da6fa08e3aa', 'volume_name': 'volume-84d939b7-d86c-4008-9018-3da6fa08e3aa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2516c1e9-4969-4d89-b4eb-703af8ae39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2516c1e9-4969-4d89-b4eb-703af8ae39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a4163-065e-4753-b300-dd15f36346d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Volume 84d939b7-d86c-4008-9018-3da6fa08e3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d939b7-d86c-4008-9018-3da6fa08e3aa', 'volume_size': 1} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,created_at=2026-11-06T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941524921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6fc66fe-0246-4761-b29c-7b56c5c1c947,host='devstack@QuobyteHD#QuobyteHD',id=84d939b7-d86c-4008-9018-3da6fa08e3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774301d805c14b349acf66b03fcd5b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:03Z,use_quota=True,user_id='d3e230cd8e4540d9b0c435b5e8bfa79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(536b9928-8427-447d-ba21-8378a4f91f49),volume_type_id=536b9928-8427-447d-ba21-8378a4f91f49)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Creating volume 84d939b7-d86c-4008-9018-3da6fa08e3aa {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:03 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa 1073741824 Nov 06 21:21:03 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:03 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa 1073741824" returned: 0 in 0.609s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:03 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa Nov 06 21:21:03 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Flow 'volume_create_manager' (ce598b39-a06b-4d71-879e-2fe741a4d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c72541-0433-456a-8afb-33d90f084e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c72541-0433-456a-8afb-33d90f084e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128329957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d58c14b-fd8a-46e6-aec7-2eea03f35dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63ecc96416e43c1b879f3fecef979c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:04Z,use_quota=True,user_id='9139818f561749c3a2ef749ad87a1af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f590d06d-e2a2-4591-9e77-038e974ecca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f590d06d-e2a2-4591-9e77-038e974ecca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec0af43-9c7a-40a4-a8ba-ed4927eafc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec0af43-9c7a-40a4-a8ba-ed4927eafc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d58c14b-fd8a-46e6-aec7-2eea03f35dd5', 'volume_name': 'volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a9abcc-6978-4a35-8de9-904777ed0086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a9abcc-6978-4a35-8de9-904777ed0086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512bdece-5eb6-4e82-a7a2-a069ef48ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5', 'volume_size': 1} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128329957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d58c14b-fd8a-46e6-aec7-2eea03f35dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63ecc96416e43c1b879f3fecef979c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:04Z,use_quota=True,user_id='9139818f561749c3a2ef749ad87a1af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Creating volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a4163-065e-4753-b300-dd15f36346d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d939b7-d86c-4008-9018-3da6fa08e3aa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0353d87-e99f-4603-ab76-e4d94892fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 1073741824 Nov 06 21:21:04 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Volume volume-84d939b7-d86c-4008-9018-3da6fa08e3aa (84d939b7-d86c-4008-9018-3da6fa08e3aa): created successfully Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0353d87-e99f-4603-ab76-e4d94892fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Flow 'volume_create_manager' (c7988ef8-b596-4352-ae55-5c9576cf5802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a4f1d4e3-3b8d-4f50-ae27-9b085b5d4c3a tempest-GroupsTest-2003584088 None] Created volume successfully. Nov 06 21:21:04 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 1073741824" returned: 0 in 0.465s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:04 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:21:04 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:05 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512bdece-5eb6-4e82-a7a2-a069ef48ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da7230d-1b19-4ec2-9175-1d55abbc3bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Volume volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 (1d58c14b-fd8a-46e6-aec7-2eea03f35dd5): created successfully Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da7230d-1b19-4ec2-9175-1d55abbc3bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Flow 'volume_create_manager' (ce598b39-a06b-4d71-879e-2fe741a4d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6eac941-2534-4908-92c6-aee0ff895774 tempest-VolumesActionsTest-569089722 None] Created volume successfully. Nov 06 21:21:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ee2b1152-a2a4-45ab-a63a-a017c0f50f94 tempest-GroupsTest-2003584088 None] Update group completed successfully. Nov 06 21:21:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-433fc914-c3e1-4098-a8f4-425eb3321d95 tempest-GroupsTest-2003584088 None] Update group completed successfully. Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Flow 'volume_create_manager' (500ee1ed-cb5d-46a3-9b5e-d37539db79ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ea116-808c-421b-bc11-befcd40c5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ea116-808c-421b-bc11-befcd40c5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1276521883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42938aa-1367-4a13-8710-7520c502408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888f29c2fe51412a84860247c58a62d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:09Z,use_quota=True,user_id='08dabb69eb59487cb706966e483788ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f05c16-6dd2-4182-b0cc-f67380b6f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f05c16-6dd2-4182-b0cc-f67380b6f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ba7f6-b832-41a5-8614-2c5e2330bf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ba7f6-b832-41a5-8614-2c5e2330bf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42938aa-1367-4a13-8710-7520c502408e', 'volume_name': 'volume-c42938aa-1367-4a13-8710-7520c502408e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9051f060-dafb-4321-ba51-557e192d035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9051f060-dafb-4321-ba51-557e192d035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144955ea-0c72-4835-9257-59b8e97ba95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Volume c42938aa-1367-4a13-8710-7520c502408e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42938aa-1367-4a13-8710-7520c502408e', 'volume_size': 1} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1276521883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42938aa-1367-4a13-8710-7520c502408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888f29c2fe51412a84860247c58a62d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:09Z,use_quota=True,user_id='08dabb69eb59487cb706966e483788ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Creating volume c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e 1073741824 Nov 06 21:21:08 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:09 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e 1073741824" returned: 0 in 0.694s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:09 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e Nov 06 21:21:09 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Acquiring lock "cinder-quobyte-84d939b7-d86c-4008-9018-3da6fa08e3aa" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-84d939b7-d86c-4008-9018-3da6fa08e3aa" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ce6f4-ed0f-4257-9ff1-eda24fbc3604]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:09 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa Nov 06 21:21:09 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:10 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e" returned: 0 in 0.517s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144955ea-0c72-4835-9257-59b8e97ba95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42938aa-1367-4a13-8710-7520c502408e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c541e15-6246-431f-b817-01643bfbe7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Volume volume-c42938aa-1367-4a13-8710-7520c502408e (c42938aa-1367-4a13-8710-7520c502408e): created successfully Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c541e15-6246-431f-b817-01643bfbe7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Flow 'volume_create_manager' (500ee1ed-cb5d-46a3-9b5e-d37539db79ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-18e62eee-3344-42d8-82c8-bb8f325841d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Created volume successfully. Nov 06 21:21:10 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa" returned: 0 in 0.529s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:10 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa Nov 06 21:21:10 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:10 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-84d939b7-d86c-4008-9018-3da6fa08e3aa" returned: 0 in 0.318s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-84d939b7-d86c-4008-9018-3da6fa08e3aa" released by "delete_volume" :: held 0.929s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Acquiring lock "cinder-quobyte-ac4ddc39-d942-41ee-933f-24c0cfc431e3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-ac4ddc39-d942-41ee-933f-24c0cfc431e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d974cc-2516-49b7-b996-3c30ea84285a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:10 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 Nov 06 21:21:10 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Creating offline snapshot 85ee2603-1e90-430a-838a-e32a3f951283 of volume c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c107de8-0bb6-4308-87c8-37ab53dbadb8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3" returned: 0 in 0.587s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3 Nov 06 21:21:11 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e Nov 06 21:21:11 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6bb6806-7a94-484c-8bda-9c0b5464fdb1 tempest-BackendsCapabilitiesAdminTestsJSON-2049766047 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:21:11 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ac4ddc39-d942-41ee-933f-24c0cfc431e3" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "cinder-quobyte-ac4ddc39-d942-41ee-933f-24c0cfc431e3" released by "delete_volume" :: held 0.981s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9d702320-ed34-411c-a434-7dad81cb1efa tempest-BackendsCapabilitiesAdminTestsJSON-2049766047 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Created reservations ['837f1c06-0fa5-4d03-bfc5-d245651abfe7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:11 devstack cinder-volume[87230]: WARNING cinder.quota [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1213506332 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1213506332, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:11 devstack cinder-volume[87230]: WARNING cinder.quota [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1213506332 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1213506332, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:11 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e" returned: 0 in 0.598s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Created reservations ['8759d2dd-bb17-4ed1-b123-25cb46e9ba0a', '1fba4123-af0c-42f0-90cc-4cdb5eff49d9', '3b6a5e74-af7d-411a-ab89-c5c94c00737a', 'a0dca07d-21f1-4d59-aa05-891ab76ceefd'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:11 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 1G Nov 06 21:21:11 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Created reservations ['f083b799-b508-44be-aaa3-37a432f75366', '8e280c72-ec44-407f-b84b-f17350c55ea3', '773fbc77-dbda-4b39-8fc1-91812b34c7a5', 'cc18380a-baa9-4a11-8749-460b4a4788ca'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:12 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 1G" returned: 0 in 0.623s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42938aa-1367-4a13-8710-7520c502408e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42938aa-1367-4a13-8710-7520c502408e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 Nov 06 21:21:12 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.587s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f6a13d5f-3d88-42dd-b05a-4f0887f08448 tempest-GroupsTest-2003584088 None] Delete group completed successfully. Nov 06 21:21:12 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c42938aa-1367-4a13-8710-7520c502408e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283" returned: 0 in 0.516s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 is being set with open permissions: ugo+rw Nov 06 21:21:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 Nov 06 21:21:12 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:13 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283" returned: 0 in 0.496s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:13 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info Nov 06 21:21:13 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:14 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info" returned: 0 in 0.564s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:14 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info is being set with open permissions: ugo+rw Nov 06 21:21:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:14 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info Nov 06 21:21:14 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:14 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.info" returned: 0 in 0.585s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-085681f3-b24f-4f1c-8c69-14d5d59f89fb tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Create snapshot completed successfully Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "cinder-85ee2603-1e90-430a-838a-e32a3f951283-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-85ee2603-1e90-430a-838a-e32a3f951283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "cinder-quobyte-85ee2603-1e90-430a-838a-e32a3f951283" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-85ee2603-1e90-430a-838a-e32a3f951283" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Deleting offline snapshot 85ee2603-1e90-430a-838a-e32a3f951283 of volume c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] snapshot_file for this snap is: volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa982a0e-8469-465b-9d87-fb344e9d8206]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22099db4-2ebf-4af9-a3c0-9cac9deeb191 tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22099db4-2ebf-4af9-a3c0-9cac9deeb191 tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" acquired by "attach_volume" :: waited 0.051s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:16 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 Nov 06 21:21:16 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-22099db4-2ebf-4af9-a3c0-9cac9deeb191 tempest-VolumesActionsTest-569089722 None] Attaching volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 to instance 31df786d-08b3-44d4-a9ee-5cb5fcd6b0b7 at mountpoint /dev/vdb on host None. Nov 06 21:21:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-22099db4-2ebf-4af9-a3c0-9cac9deeb191 tempest-VolumesActionsTest-569089722 None] Attach volume completed successfully. Nov 06 21:21:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-22099db4-2ebf-4af9-a3c0-9cac9deeb191 tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" released by "attach_volume" :: held 0.190s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21407232-41f5-48c6-aa1f-d95d856c70c6 tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21407232-41f5-48c6-aa1f-d95d856c70c6 tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-21407232-41f5-48c6-aa1f-d95d856c70c6 tempest-VolumesActionsTest-569089722 None] Detaching volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 from instance 31df786d-08b3-44d4-a9ee-5cb5fcd6b0b7. Nov 06 21:21:17 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c42938aa-1367-4a13-8710-7520c502408e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[456131bd-d5b9-4d32-83cc-a2224198ecb0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-21407232-41f5-48c6-aa1f-d95d856c70c6 tempest-VolumesActionsTest-569089722 None] Detach volume completed successfully. Nov 06 21:21:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-21407232-41f5-48c6-aa1f-d95d856c70c6 tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" released by "detach_volume" :: held 0.275s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:17 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e Nov 06 21:21:17 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:18 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e" returned: 0 in 0.706s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:18 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 Nov 06 21:21:18 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:18 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:18 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283 Nov 06 21:21:18 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:19 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e.85ee2603-1e90-430a-838a-e32a3f951283" returned: 0 in 0.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-85ee2603-1e90-430a-838a-e32a3f951283" released by "_delete_snapshot" :: held 2.642s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" released by "delete_snapshot" :: held 2.698s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Created reservations ['f96f3882-2981-405b-b09b-76983dbaa962', 'a9da7ba6-80b7-4276-b0bb-4f3bc7588bb7', '528868a5-5ac9-46da-a9c6-4cf8239ffea6', '63e8f96e-9428-4275-bd5e-b888196444e9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Delete snapshot completed successfully. Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-855331e7-8a18-498c-a007-87783b048249 tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-85ee2603-1e90-430a-838a-e32a3f951283-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "cinder-c42938aa-1367-4a13-8710-7520c502408e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-c42938aa-1367-4a13-8710-7520c502408e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad22ba0-fe45-495a-a28f-98abe80de435]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:20 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e Nov 06 21:21:20 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:20 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e" returned: 0 in 0.489s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:20 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e Nov 06 21:21:20 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:20 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c42938aa-1367-4a13-8710-7520c502408e" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-quobyte-c42938aa-1367-4a13-8710-7520c502408e" released by "delete_volume" :: held 0.905s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Created reservations ['3e2fd4c2-91fa-433b-84e6-80a4625f51ee', 'ce2b5df1-d87b-4949-a262-438add541360', '790bccbc-ec87-41c8-8c5e-9d7c4808cee3', '381939b9-e813-4c93-87a6-4d5effe3316a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:20 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:20 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:21 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Deleted volume successfully. Nov 06 21:21:21 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:INSERT=31,cinder:UPDATE=125,cinder:DELETE=7,cinder:SELECT=114 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d579e6f0-6033-4648-ba6c-17a2946bcced tempest-VolumeSnapshotQuotasNegativeTestJSON-592539297 None] Lock "cinder-c42938aa-1367-4a13-8710-7520c502408e-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:22 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=102,cinder:UPDATE=133,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1cd282c0-6cad-435b-bb30-54188c6ae548 tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-600711377: creating Nov 06 21:21:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1cd282c0-6cad-435b-bb30-54188c6ae548 tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-600711377: created successfully Nov 06 21:21:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1cd282c0-6cad-435b-bb30-54188c6ae548 tempest-GroupSnapshotsTest-1838131471 None] Create group completed successfully. Nov 06 21:21:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8509de8d-07cd-49aa-8dc5-9f681f9e804d tempest-GroupsV314Test-1896614072 None] Group tempest-GroupsV314Test-Group-623894247: creating Nov 06 21:21:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (e2607e9f-a28a-4541-9423-8da711319507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b81f017-36bd-4873-b5f4-91a3914393c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b81f017-36bd-4873-b5f4-91a3914393c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516842518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5297f211-a9e5-47a3-b8dc-15e8d1f8a836,host='devstack@QuobyteHD#QuobyteHD',id=c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:25Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0135d75-a999-4e0e-972d-c3432e8adf82),volume_type_id=c0135d75-a999-4e0e-972d-c3432e8adf82)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82573b33-ebb1-4239-95ce-d6447dcad8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82573b33-ebb1-4239-95ce-d6447dcad8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1617b37-d307-4838-84eb-1bc9536baa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1617b37-d307-4838-84eb-1bc9536baa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5', 'volume_name': 'volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84bfad3-df20-4b40-b17a-926a4070f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84bfad3-df20-4b40-b17a-926a4070f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3485c1d-b166-4695-8509-fb83916e0b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Volume c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5', 'volume_size': 1} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5297f211-a9e5-47a3-b8dc-15e8d1f8a836,created_at=2026-11-06T20:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1516842518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5297f211-a9e5-47a3-b8dc-15e8d1f8a836,host='devstack@QuobyteHD#QuobyteHD',id=c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:25Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0135d75-a999-4e0e-972d-c3432e8adf82),volume_type_id=c0135d75-a999-4e0e-972d-c3432e8adf82)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Creating volume c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8509de8d-07cd-49aa-8dc5-9f681f9e804d tempest-GroupsV314Test-1896614072 None] Group tempest-GroupsV314Test-Group-623894247: created successfully Nov 06 21:21:25 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 1073741824 Nov 06 21:21:25 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8509de8d-07cd-49aa-8dc5-9f681f9e804d tempest-GroupsV314Test-1896614072 None] Create group completed successfully. Nov 06 21:21:25 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 1073741824" returned: 0 in 0.584s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:25 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:21:25 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:26 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3485c1d-b166-4695-8509-fb83916e0b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753ba86c-25cd-40be-bbb8-3657c5b991e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Volume volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 (c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5): created successfully Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753ba86c-25cd-40be-bbb8-3657c5b991e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (e2607e9f-a28a-4541-9423-8da711319507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-abb007d2-ba34-4666-a2eb-23df4aca4c0a tempest-GroupSnapshotsTest-1838131471 None] Created volume successfully. Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Flow 'volume_create_manager' (402554a9-3c09-4dfc-8aa7-ac6cbce5e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce97406d-bb35-4e62-8376-93085e3bf7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce97406d-bb35-4e62-8376-93085e3bf7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2002104133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d3102b6-32ba-4411-9b2f-58ac427f9a61,host='devstack@QuobyteHD#QuobyteHD',id=3df5353d-75b4-42a4-8104-39d697a09b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd4ae66e7384e3fa3e6fdd3e0fb97d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:27Z,use_quota=True,user_id='cfc22d3ec70a42d3b691eccec1ce7c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1575630f-8c96-4f7f-aeb3-e62d39078d86),volume_type_id=1575630f-8c96-4f7f-aeb3-e62d39078d86)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784069e-7123-46e3-a1c5-37c2b4e3eec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2784069e-7123-46e3-a1c5-37c2b4e3eec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e54edf2-12d4-4b07-baa2-ee740b0b6e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e54edf2-12d4-4b07-baa2-ee740b0b6e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df5353d-75b4-42a4-8104-39d697a09b5b', 'volume_name': 'volume-3df5353d-75b4-42a4-8104-39d697a09b5b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191338e-a17a-4db2-847c-81db55a0d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191338e-a17a-4db2-847c-81db55a0d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547ab20d-7462-4695-912c-163d987066da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Volume 3df5353d-75b4-42a4-8104-39d697a09b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df5353d-75b4-42a4-8104-39d697a09b5b', 'volume_size': 1} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d3102b6-32ba-4411-9b2f-58ac427f9a61,created_at=2026-11-06T20:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2002104133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d3102b6-32ba-4411-9b2f-58ac427f9a61,host='devstack@QuobyteHD#QuobyteHD',id=3df5353d-75b4-42a4-8104-39d697a09b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd4ae66e7384e3fa3e6fdd3e0fb97d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:27Z,use_quota=True,user_id='cfc22d3ec70a42d3b691eccec1ce7c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1575630f-8c96-4f7f-aeb3-e62d39078d86),volume_type_id=1575630f-8c96-4f7f-aeb3-e62d39078d86)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Creating volume 3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:26 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b 1073741824 Nov 06 21:21:26 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:27 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b 1073741824" returned: 0 in 0.585s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:27 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:27 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] GroupSnapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: creating. Nov 06 21:21:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Group snapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:21:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:28 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.555s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.031s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547ab20d-7462-4695-912c-163d987066da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df5353d-75b4-42a4-8104-39d697a09b5b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dd8b85-628c-461f-9f74-368662508938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Creating offline snapshot 94f110fd-01f0-41b9-ad8b-c30818fa2225 of volume c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Volume volume-3df5353d-75b4-42a4-8104-39d697a09b5b (3df5353d-75b4-42a4-8104-39d697a09b5b): created successfully Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dd8b85-628c-461f-9f74-368662508938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Flow 'volume_create_manager' (402554a9-3c09-4dfc-8aa7-ac6cbce5e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47d6c8-5ca6-432f-974e-39df790f736a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f1d7817-f82e-4963-9602-f8135d271f03 tempest-GroupsV314Test-1896614072 None] Created volume successfully. Nov 06 21:21:28 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:21:28 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:28 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 1G Nov 06 21:21:28 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 1G" returned: 0 in 0.728s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:29 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:21:29 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.565s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:21:30 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.413s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info Nov 06 21:21:30 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:31 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info" returned: 0 in 0.458s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:31 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:31 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info Nov 06 21:21:31 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-04ee527a-3c3f-45e2-be60-327f1e0269ce tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:31 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.info" returned: 0 in 0.517s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.598s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.872s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Cloning volume 3df5353d-75b4-42a4-8104-39d697a09b5b to volume 74352781-2432-4eb4-b039-944323285203 Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-04ee527a-3c3f-45e2-be60-327f1e0269ce tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" acquired by "attach_volume" :: waited 0.095s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Creating offline snapshot 4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 of volume 3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[59276cf4-7aa2-458d-8e40-21387be8de01]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-04ee527a-3c3f-45e2-be60-327f1e0269ce tempest-VolumesActionsTest-569089722 None] Attaching volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 to instance 3ed16773-99c1-443f-9f97-3841b050053e at mountpoint /dev/vdb on host None. Nov 06 21:21:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-04b95e8f-fb91-42f2-9071-741925b03dca tempest-GroupSnapshotsTest-1838131471 None] group_snapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: created successfully Nov 06 21:21:31 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:31 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-04ee527a-3c3f-45e2-be60-327f1e0269ce tempest-VolumesActionsTest-569089722 None] Attach volume completed successfully. Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-04ee527a-3c3f-45e2-be60-327f1e0269ce tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" released by "attach_volume" :: held 0.312s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Flow 'volume_create_manager' (c17ba420-a0a6-43de-9f18-9ef32ddbe4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ce6334-dbd2-47ed-9ff2-c429ae595bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ce6334-dbd2-47ed-9ff2-c429ae595bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-497942775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd6070-0816-4c29-8738-ed301f599143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fd323a860640f9a346e182d6134014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:32Z,use_quota=True,user_id='c4fa042f954842369e54919fa14a8e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f83487-fdfa-473c-98c4-8821656a81c4),volume_type_id=74f83487-fdfa-473c-98c4-8821656a81c4)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c322e82d-b215-4d7e-a56c-99456069e6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c322e82d-b215-4d7e-a56c-99456069e6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69819008-a90b-42c1-bf84-6f7461070cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69819008-a90b-42c1-bf84-6f7461070cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fd6070-0816-4c29-8738-ed301f599143', 'volume_name': 'volume-18fd6070-0816-4c29-8738-ed301f599143', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fbba0e-c5f0-4aef-87e7-1143beb70588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fbba0e-c5f0-4aef-87e7-1143beb70588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d57b2a-36b7-4c0a-8482-41feed3ebc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Volume 18fd6070-0816-4c29-8738-ed301f599143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fd6070-0816-4c29-8738-ed301f599143', 'volume_size': 1} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:32 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.535s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 1G Nov 06 21:21:32 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3ce5e1e-c77c-4bab-86c6-fdbb3ebdb52a tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3ce5e1e-c77c-4bab-86c6-fdbb3ebdb52a tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e3ce5e1e-c77c-4bab-86c6-fdbb3ebdb52a tempest-VolumesActionsTest-569089722 None] Detaching volume 1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 from instance 3ed16773-99c1-443f-9f97-3841b050053e. Nov 06 21:21:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e3ce5e1e-c77c-4bab-86c6-fdbb3ebdb52a tempest-VolumesActionsTest-569089722 None] Detach volume completed successfully. Nov 06 21:21:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3ce5e1e-c77c-4bab-86c6-fdbb3ebdb52a tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:33 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 1G" returned: 0 in 0.768s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df5353d-75b4-42a4-8104-39d697a09b5b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df5353d-75b4-42a4-8104-39d697a09b5b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:33 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df5353d-75b4-42a4-8104-39d697a09b5b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.464s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:33 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:33 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.356s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:34 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info Nov 06 21:21:34 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:34 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info" returned: 0 in 0.309s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:34 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info Nov 06 21:21:34 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:34 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.info" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Acquiring lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] snapshot: 4a7c9014-02fe-4ef7-a35b-ab77b3cbe861, volume: 74352781-2432-4eb4-b039-944323285203, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b0ddb-25c4-4358-b0d8-832061941240]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:34 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:34 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:35 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.442s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df5353d-75b4-42a4-8104-39d697a09b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f24b9-e033-42a9-868b-22b98fcb3858]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:35 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:35 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.389s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:21:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:35 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 Nov 06 21:21:35 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:38 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:38 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:38 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.704s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:21:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:21:42 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203" returned: 0 in 6.648s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:21:42 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Converted 1024.00 MB image at 154.01 MB/s Nov 06 21:21:42 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:42 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 Nov 06 21:21:42 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:42 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" released by "_copy_volume_from_snapshot" :: held 7.823s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Acquiring lock "cinder-quobyte-4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Deleting offline snapshot 4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 of volume 3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] snapshot_file for this snap is: volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcc4d2-a5c6-48ee-b5df-db1b0b301b9d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:42 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:42 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:42 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.381s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df5353d-75b4-42a4-8104-39d697a09b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd489f2-4e7e-4a66-a711-dd12fa0b87bd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:43 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:43 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:43 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.532s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:43 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:43 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:43 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:43 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861 Nov 06 21:21:43 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:44 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b.4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-4a7c9014-02fe-4ef7-a35b-ab77b3cbe861" released by "_delete_snapshot" :: held 1.652s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.567s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.981s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-497942775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd6070-0816-4c29-8738-ed301f599143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fd323a860640f9a346e182d6134014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:32Z,use_quota=True,user_id='c4fa042f954842369e54919fa14a8e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f83487-fdfa-473c-98c4-8821656a81c4),volume_type_id=74f83487-fdfa-473c-98c4-8821656a81c4)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Creating volume 18fd6070-0816-4c29-8738-ed301f599143 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:44 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 1073741824 Nov 06 21:21:44 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-eb1c6399-c883-4289-90af-df83f7d12d43 tempest-GroupsV314Test-1896614072 None] Create group from source-group-1d3102b6-32ba-4411-9b2f-58ac427f9a61 completed successfully. Nov 06 21:21:44 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 1073741824" returned: 0 in 0.419s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:44 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 Nov 06 21:21:44 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:44 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.180s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225-358aa7a2-62f1-4595-8c49-4117aa0507bb" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d57b2a-36b7-4c0a-8482-41feed3ebc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fd6070-0816-4c29-8738-ed301f599143', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f726594f-196a-4dbe-ab8f-830608e058ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225-358aa7a2-62f1-4595-8c49-4117aa0507bb" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Creating volume 358aa7a2-62f1-4595-8c49-4117aa0507bb from snapshot 94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Volume volume-18fd6070-0816-4c29-8738-ed301f599143 (18fd6070-0816-4c29-8738-ed301f599143): created successfully Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f726594f-196a-4dbe-ab8f-830608e058ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Flow 'volume_create_manager' (c17ba420-a0a6-43de-9f18-9ef32ddbe4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] snapshot: 94f110fd-01f0-41b9-ad8b-c30818fa2225, volume: 358aa7a2-62f1-4595-8c49-4117aa0507bb, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:21:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f029c10c-fe07-49a0-95a9-c6bee3cfd91f tempest-VolumeTypesAccessTest-518931477 None] Created volume successfully. Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b6fd5-b90c-44e0-8507-e03eccdabdf0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:21:45 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Acquiring lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5bf62-be6d-4659-a140-d7ce93da0994]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.432s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e030153-1fb9-4aa2-b2ad-39a1d9f51fa6]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Acquiring lock "cinder-18fd6070-0816-4c29-8738-ed301f599143-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "cinder-18fd6070-0816-4c29-8738-ed301f599143-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:45 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:21:45 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 Nov 06 21:21:45 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Acquiring lock "cinder-quobyte-18fd6070-0816-4c29-8738-ed301f599143" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "cinder-quobyte-18fd6070-0816-4c29-8738-ed301f599143" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d91acf-5ba7-4963-ad67-a71813297932]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 Nov 06 21:21:45 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.416s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203" returned: 0 in 0.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb Nov 06 21:21:45 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203 Nov 06 21:21:46 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143" returned: 0 in 0.401s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143 Nov 06 21:21:46 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-74352781-2432-4eb4-b039-944323285203" returned: 0 in 0.298s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-74352781-2432-4eb4-b039-944323285203" released by "delete_volume" :: held 0.820s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Created reservations ['5a0e8156-bd81-45ec-916c-9741e1703598'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:46 devstack cinder-volume[87230]: WARNING cinder.quota [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1509301951 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1509301951, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:46 devstack cinder-volume[87230]: WARNING cinder.quota [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1509301951 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1509301951, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Created reservations ['de3de6cf-190a-4efd-ab83-963b2abe1a9a', '10aa8e5e-aec3-42a5-8e20-52a6311aaabf', '41034c8c-6554-4560-8996-d22ec5008530', '46a6211c-3046-4141-b0a9-1ebabc4c6473'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:46 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-18fd6070-0816-4c29-8738-ed301f599143" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "cinder-quobyte-18fd6070-0816-4c29-8738-ed301f599143" released by "delete_volume" :: held 0.791s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:46 devstack cinder-volume[87230]: WARNING cinder.quota [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-893016739 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-893016739, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:46 devstack cinder-volume[87230]: WARNING cinder.quota [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-893016739 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-893016739, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Created reservations ['417449d2-3a6c-4df2-b410-249d0f83573d', '3e2d847c-9ca5-4cca-b4cf-425408566b90', '3dc0228c-d44e-4990-8a95-98969a81af00', '36490368-7012-47b9-b177-bb452e74da9a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:46 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:46 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:46 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-113bda0b-70cf-46af-b04c-84481021a985 tempest-GroupsV314Test-1896614072 None] Delete group completed successfully. Nov 06 21:21:47 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.513s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Deleted volume successfully. Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dcd2e655-8c20-488d-8d1b-f7f565ae867b tempest-VolumeTypesAccessTest-518931477 None] Lock "cinder-18fd6070-0816-4c29-8738-ed301f599143-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Acquiring lock "cinder-quobyte-3df5353d-75b4-42a4-8104-39d697a09b5b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-3df5353d-75b4-42a4-8104-39d697a09b5b" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[920bcc8d-7500-4ef9-9d75-d1de3d31121e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:47 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.734s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:48 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b Nov 06 21:21:48 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3df5353d-75b4-42a4-8104-39d697a09b5b" returned: 0 in 0.485s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Lock "cinder-quobyte-3df5353d-75b4-42a4-8104-39d697a09b5b" released by "delete_volume" :: held 1.413s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Created reservations ['3c78dc42-3464-49cd-8d70-eab4e01adf99'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Created reservations ['70632eaa-84dc-4143-aba6-b43fbb8d7eae', '3e0e61b3-99bf-4d6a-b6eb-f6d9fb2e56b7', '843f4782-c321-489a-85dd-30edd3414afa', 'ac2240fe-d530-4e87-8edc-f235f98bc7c5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:49 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.570s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:50 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b1cf5800-24ea-40f5-a559-beaa75ad5fcf tempest-GroupsV314Test-1896614072 None] Delete group completed successfully. Nov 06 21:21:54 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb" returned: 0 in 8.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:21:54 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Converted 1024.00 MB image at 121.60 MB/s Nov 06 21:21:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:54 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb Nov 06 21:21:54 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:54 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" released by "_copy_volume_from_snapshot" :: held 9.716s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225-358aa7a2-62f1-4595-8c49-4117aa0507bb" released by "_create_volume_from_snapshot" :: held 9.803s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.837s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 15.882s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[43722521-e184-4bb8-af45-2fa46a06801d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e3bc71e6-d53d-437d-b8da-cce752b1f38c tempest-GroupSnapshotsTest-1838131471 None] Create group from source-snapshot-d4e33eb1-7804-4731-bb0f-3b4df1a5dda4 completed successfully. Nov 06 21:21:54 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:21:54 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.474s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b4cf1-ec5b-48e5-acd6-093bbebf9f93]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:21:55 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.496s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.fb609a95-a04d-45e3-9383-0aa8599264e30m2e9rvu.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.fb609a95-a04d-45e3-9383-0aa8599264e30m2e9rvu.img Nov 06 21:21:55 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce370c3d-196a-429d-8e36-750dad4db78a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:56 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb Nov 06 21:21:56 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:57 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb" returned: 0 in 0.856s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:57 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb Nov 06 21:21:57 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:58 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-358aa7a2-62f1-4595-8c49-4117aa0507bb" returned: 0 in 0.592s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-358aa7a2-62f1-4595-8c49-4117aa0507bb" released by "delete_volume" :: held 1.604s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['d533d89e-8a63-4fa7-9cbd-8f6f553680bf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:58 devstack cinder-volume[87230]: WARNING cinder.quota [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2110259431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2110259431, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:58 devstack cinder-volume[87230]: WARNING cinder.quota [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2110259431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2110259431, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['88fc714f-8766-44d0-a3e3-d807691e689d', 'f72d4db4-0d4a-4295-ab10-32b302cceb25', '5a7e38a8-5812-4df0-ae60-56c29d4697ee', '779022e3-1d36-4acc-ac69-9d560035e69e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:58 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:21:58 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:59 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.504s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2b74415b-9319-4da1-a12a-be2031d5d260 tempest-GroupSnapshotsTest-1838131471 None] Delete group completed successfully. Nov 06 21:21:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] group_snapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: deleting Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] group_snapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Deleting offline snapshot 94f110fd-01f0-41b9-ad8b-c30818fa2225 of volume c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] snapshot_file for this snap is: volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff982136-e2f6-41aa-a314-bcbb355194bf]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:59 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:21:59 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:00 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.755s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:00 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ed62f-d19a-4030-ac77-bbd7937bf4d8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:00 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:22:00 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.998s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:22:01 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.771s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:02 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225 Nov 06 21:22:02 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:02 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5.94f110fd-01f0-41b9-ad8b-c30818fa2225" returned: 0 in 0.543s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-94f110fd-01f0-41b9-ad8b-c30818fa2225" released by "_delete_snapshot" :: held 3.340s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" released by "delete_snapshot" :: held 3.416s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:03 devstack cinder-volume[87230]: WARNING cinder.quota [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2110259431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2110259431, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:03 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['4ceb01d7-51ac-4079-abff-12a5524fa855', 'a9fd6aaa-742f-4aee-8a97-f2b105a10038', '60f398fa-3d9f-4a79-b456-a3d6677d0c27', '6034b0e4-31d8-4e25-90c8-cc925376cfba'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8d372661-c4c8-4139-ae37-a09edb72a7cb tempest-GroupSnapshotsTest-1838131471 None] group_snapshot d4e33eb1-7804-4731-bb0f-3b4df1a5dda4: deleted successfully Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba32c1-6fa8-4689-b213-13c3133dc3a9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:05 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.fb609a95-a04d-45e3-9383-0aa8599264e30m2e9rvu.img" returned: 0 in 9.469s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d793a7f-709e-4fb9-92a4-abc4eb2afee2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:05 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:22:05 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Flow 'volume_create_manager' (e6d9271b-1ccf-4abf-bdc6-a63d651439f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26777262-52ee-4ba1-b61f-fe3c772ef970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:05 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26777262-52ee-4ba1-b61f-fe3c772ef970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1956499488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ddb660-dea3-478e-9033-251d61f9d293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1a9cbe64464a6f9ae50dade88ae25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:05Z,use_quota=True,user_id='ef87c5a1fae24b118133426e7819c076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e507045-cd77-4e33-af68-b65af92a9490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e507045-cd77-4e33-af68-b65af92a9490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8014e9-ec21-49ef-ad52-875a78d19c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8014e9-ec21-49ef-ad52-875a78d19c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ddb660-dea3-478e-9033-251d61f9d293', 'volume_name': 'volume-d2ddb660-dea3-478e-9033-251d61f9d293', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275a4fd-d77a-4a33-b2ee-3e79409383ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7275a4fd-d77a-4a33-b2ee-3e79409383ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31013a3-01b2-4245-a611-0e03313356b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Volume d2ddb660-dea3-478e-9033-251d61f9d293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ddb660-dea3-478e-9033-251d61f9d293', 'volume_size': 1} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:05 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.462s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:05 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5 Nov 06 21:22:05 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:05 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.621s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5, size 1024.00 MB, duration 9.47 sec, destination /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.fb609a95-a04d-45e3-9383-0aa8599264e30m2e9rvu.img {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:05 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Converted 1024.00 MB image at 108.12 MB/s Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] fb609a95-a04d-45e3-9383-0aa8599264e3 was raw, no need to convert to raw {{(pid=87230) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:22:05 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" returned: 0 in 0.301s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-c6f3e8bc-6a8d-4c8b-9b1e-9650cc4f21d5" released by "delete_volume" :: held 0.840s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['31a408a5-1644-43e2-a94e-4fa5667bffcc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:06 devstack cinder-volume[87230]: WARNING cinder.db.api [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2110259431'] Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['d0b88830-3936-4311-9ae1-9a3cfaf96d23', '6151de03-c741-456e-87b5-00bb219ce012', 'bb788cef-405d-481f-9942-0f2f38a00d71', '5cd9748e-c757-48b7-9810-d3311ba0f276'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:06 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:06 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:06 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3e0f6328-4017-4a13-9440-ddae0298058f tempest-GroupSnapshotsTest-1838131471 None] Delete group completed successfully. Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Flow 'volume_create_manager' (fd48a89e-ac5a-4df4-b20d-cc6c067f4b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353696b2-09cc-4add-b9a8-bdfaaeb8662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353696b2-09cc-4add-b9a8-bdfaaeb8662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-273218127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2052d35b-4d42-4425-aed0-a796544fb4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0687373eb05c45f0837fc16e8b84b136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:08Z,use_quota=True,user_id='f5208b361f964af690dc704ce82ee00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb19b3f2-f77d-4e20-a44b-af5a6eb3d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb19b3f2-f77d-4e20-a44b-af5a6eb3d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdc35c7-9777-40a9-9673-d0ff7ea2d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:22:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2881f077-9d71-4cc8-ab70-33514df06bf1 tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-1770083498: creating Nov 06 21:22:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2881f077-9d71-4cc8-ab70-33514df06bf1 tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-1770083498: created successfully Nov 06 21:22:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2881f077-9d71-4cc8-ab70-33514df06bf1 tempest-GroupSnapshotsTest-1838131471 None] Create group completed successfully. Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdc35c7-9777-40a9-9673-d0ff7ea2d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2052d35b-4d42-4425-aed0-a796544fb4a2', 'volume_name': 'volume-2052d35b-4d42-4425-aed0-a796544fb4a2', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f6766f-5546-4d0c-b072-def711936793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f6766f-5546-4d0c-b072-def711936793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd77799-ffb5-47ee-869e-44e4af0c2372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Volume 2052d35b-4d42-4425-aed0-a796544fb4a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2052d35b-4d42-4425-aed0-a796544fb4a2', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Trying to clone 2052d35b-4d42-4425-aed0-a796544fb4a2 from image 007d3188-64b0-400e-a10b-94dd7e89a175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:22:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:22:08 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106ed03-0592-4ae4-8cc8-0015951b0b7f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:09 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD Nov 06 21:22:09 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:09 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 is fetched for user f5208b361f964af690dc704ce82ee00b. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7b8e6-e625-4cce-bfab-17d4f8895891]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:09 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD Nov 06 21:22:09 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (b1e4209f-bbf1-445c-9c3f-af1e2fa700c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909bcdc2-16ee-4b06-87c6-f0bcaa7581d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:10 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909bcdc2-16ee-4b06-87c6-f0bcaa7581d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946461286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef12ba5-971f-4f29-893d-19e219928516,host='devstack@QuobyteHD#QuobyteHD',id=88248c6a-6630-44e1-9962-492e4c870fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:10Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c290c1b2-da7a-409f-81cb-3f833b461230),volume_type_id=c290c1b2-da7a-409f-81cb-3f833b461230)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102f5111-86bf-494f-bee8-1a6781088426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102f5111-86bf-494f-bee8-1a6781088426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9c5c80-e451-459b-8ecf-6b44162dffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9c5c80-e451-459b-8ecf-6b44162dffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88248c6a-6630-44e1-9962-492e4c870fc2', 'volume_name': 'volume-88248c6a-6630-44e1-9962-492e4c870fc2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65b1fe0-096a-4361-895c-8d06fabad6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65b1fe0-096a-4361-895c-8d06fabad6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd603d03-681d-4944-9b99-d48c9259bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Volume 88248c6a-6630-44e1-9962-492e4c870fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88248c6a-6630-44e1-9962-492e4c870fc2', 'volume_size': 1} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD" returned: 0 in 0.608s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:19 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=80,cinder:SELECT=79,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=92,cinder:UPDATE=82,cinder:DELETE=3,cinder:INSERT=22 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.890s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Uploaded volume to glance image-id: fb609a95-a04d-45e3-9383-0aa8599264e3. {{(pid=87230) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.123s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1956499488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ddb660-dea3-478e-9033-251d61f9d293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1a9cbe64464a6f9ae50dade88ae25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:05Z,use_quota=True,user_id='ef87c5a1fae24b118133426e7819c076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Creating volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 1073741824 Nov 06 21:22:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7b88cc38-d089-4808-9878-19ff8ba175ab tempest-VolumesActionsTest-569089722 None] Copy volume to image completed successfully. Nov 06 21:22:25 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 1073741824" returned: 0 in 0.478s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 Nov 06 21:22:26 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293" returned: 0 in 0.293s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.385s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ef12ba5-971f-4f29-893d-19e219928516,created_at=2026-11-06T20:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946461286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef12ba5-971f-4f29-893d-19e219928516,host='devstack@QuobyteHD#QuobyteHD',id=88248c6a-6630-44e1-9962-492e4c870fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:10Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c290c1b2-da7a-409f-81cb-3f833b461230),volume_type_id=c290c1b2-da7a-409f-81cb-3f833b461230)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Creating volume 88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31013a3-01b2-4245-a611-0e03313356b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ddb660-dea3-478e-9033-251d61f9d293', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:26 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 1073741824 Nov 06 21:22:26 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4578b-7a39-4aea-9d88-f44aa112b6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Volume volume-d2ddb660-dea3-478e-9033-251d61f9d293 (d2ddb660-dea3-478e-9033-251d61f9d293): created successfully Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4578b-7a39-4aea-9d88-f44aa112b6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Flow 'volume_create_manager' (e6d9271b-1ccf-4abf-bdc6-a63d651439f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bf207e59-4ef1-46bc-8a6a-906724e6acb2 tempest-SnapshotsActionsTest-782655718 None] Created volume successfully. Nov 06 21:22:27 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 1073741824" returned: 0 in 0.548s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 Nov 06 21:22:27 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:27 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.264s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-273218127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2052d35b-4d42-4425-aed0-a796544fb4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0687373eb05c45f0837fc16e8b84b136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:08Z,use_quota=True,user_id='f5208b361f964af690dc704ce82ee00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Creating volume 2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:27 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd603d03-681d-4944-9b99-d48c9259bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88248c6a-6630-44e1-9962-492e4c870fc2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:27 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1073741824 Nov 06 21:22:27 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87c04f2-6b69-4b78-8e3d-8bbdd6208a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Volume volume-88248c6a-6630-44e1-9962-492e4c870fc2 (88248c6a-6630-44e1-9962-492e4c870fc2): created successfully Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87c04f2-6b69-4b78-8e3d-8bbdd6208a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (b1e4209f-bbf1-445c-9c3f-af1e2fa700c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3ba1b1e5-ba2f-45c2-baf5-d1cd8d3a5feb tempest-GroupSnapshotsTest-1838131471 None] Created volume successfully. Nov 06 21:22:27 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1073741824" returned: 0 in 0.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 Nov 06 21:22:27 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2" returned: 0 in 0.281s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.060s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Creating offline snapshot 2bb8a76e-7417-4c1d-9041-c87472c618c8 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b573b2-91c2-4011-be5a-0ca88846b2dc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Attempting download of 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 2052d35b-4d42-4425-aed0-a796544fb4a2. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (6fc46d4a-9284-4b8c-9841-e29c45c27aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce588949-be17-4af8-9c2b-1e137ee13dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce588949-be17-4af8-9c2b-1e137ee13dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533729321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef12ba5-971f-4f29-893d-19e219928516,host='devstack@QuobyteHD#QuobyteHD',id=5a46fc7a-68c5-489b-9fc9-4d40435f349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:28Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c290c1b2-da7a-409f-81cb-3f833b461230),volume_type_id=c290c1b2-da7a-409f-81cb-3f833b461230)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 Nov 06 21:22:28 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c359dd2-4fd6-48fb-b0bc-0a89d5094042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c359dd2-4fd6-48fb-b0bc-0a89d5094042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e077d2df-bae8-4528-ac09-cc6eae66786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e077d2df-bae8-4528-ac09-cc6eae66786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a46fc7a-68c5-489b-9fc9-4d40435f349a', 'volume_name': 'volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a05dbd-9376-4b3c-abda-a9d25561abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a05dbd-9376-4b3c-abda-a9d25561abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770712e3-00a4-4803-a367-5bd7eeefc475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Volume 5a46fc7a-68c5-489b-9fc9-4d40435f349a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a', 'volume_size': 1} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e39f5-2171-47e1-9d67-0c4a1b1f7256]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01 Nov 06 21:22:28 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293" returned: 0 in 0.407s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 1G Nov 06 21:22:28 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01" returned: 0 in 0.370s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01 Nov 06 21:22:28 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 1G" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:29 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01" returned: 1 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_l9ty_p01' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2142e460-b375-449b-aeb6-a932a25bcedb]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD Nov 06 21:22:29 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 is being set with open permissions: ugo+rw Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:29 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] 007d3188-64b0-400e-a10b-94dd7e89a175 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 Nov 06 21:22:29 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.252s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info Nov 06 21:22:29 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info" returned: 0 in 0.301s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info is being set with open permissions: ugo+rw Nov 06 21:22:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info Nov 06 21:22:29 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:30 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.info" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.122s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eebdbb2-47f7-4095-98b7-c1ed6cf9f4e7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0f199cdb-cbe1-4fa2-9daa-944ce1cfdb23 tempest-SnapshotsActionsTest-782655718 None] Create snapshot completed successfully Nov 06 21:22:30 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:30 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:30 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.446s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[373baf24-69c1-487e-887b-ca9332c497c4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:30 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:30 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:31 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:31 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img Nov 06 21:22:31 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:31 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2" returned: 0 in 1.962s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:31 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_85jwjuyydevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:31 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Converted 112.00 MB image at 57.02 MB/s Nov 06 21:22:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:31 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1G Nov 06 21:22:31 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:32 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 1G" returned: 0 in 0.618s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Downloaded image 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 2052d35b-4d42-4425-aed0-a796544fb4a2 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 for user f5208b361f964af690dc704ce82ee00b is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Marking volume 2052d35b-4d42-4425-aed0-a796544fb4a2 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Copying metadata from image 007d3188-64b0-400e-a10b-94dd7e89a175 to 2052d35b-4d42-4425-aed0-a796544fb4a2. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Creating volume glance metadata for volume 2052d35b-4d42-4425-aed0-a796544fb4a2 backed by image 007d3188-64b0-400e-a10b-94dd7e89a175 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd77799-ffb5-47ee-869e-44e4af0c2372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2052d35b-4d42-4425-aed0-a796544fb4a2', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b98a13-bae7-4bd7-b647-430ce053e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Volume volume-2052d35b-4d42-4425-aed0-a796544fb4a2 (2052d35b-4d42-4425-aed0-a796544fb4a2): created successfully Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b98a13-bae7-4bd7-b647-430ce053e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Flow 'volume_create_manager' (fd48a89e-ac5a-4df4-b20d-cc6c067f4b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3eb8d2eb-6954-4007-bab3-67b5515ace04 tempest-VolumesImageMetadata-939372300 None] Created volume successfully. Nov 06 21:22:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Acquiring lock "cinder-2052d35b-4d42-4425-aed0-a796544fb4a2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "cinder-2052d35b-4d42-4425-aed0-a796544fb4a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Acquiring lock "cinder-quobyte-2052d35b-4d42-4425-aed0-a796544fb4a2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "cinder-quobyte-2052d35b-4d42-4425-aed0-a796544fb4a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0872e40-26d4-461c-99a9-0334c0d89596]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:33 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 Nov 06 21:22:33 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:34 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2" returned: 0 in 0.644s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:34 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2 Nov 06 21:22:34 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:34 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2052d35b-4d42-4425-aed0-a796544fb4a2" returned: 0 in 0.391s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "cinder-quobyte-2052d35b-4d42-4425-aed0-a796544fb4a2" released by "delete_volume" :: held 1.142s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Created reservations ['2fd72fed-be55-4633-83bf-326d3d7a9baa', 'c1cef2f8-98a0-4091-9582-5dd84274a4c6', '745021e5-b0e4-4b82-8b8d-d61384791c10', 'faf432f2-ae83-4a82-b72a-71ee3f9fd2e1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:35 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:35 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:35 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.372s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Deleted volume successfully. Nov 06 21:22:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0257c8-fcac-4686-ac12-849067d32b9f tempest-VolumesImageMetadata-939372300 None] Lock "cinder-2052d35b-4d42-4425-aed0-a796544fb4a2-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:38 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:38 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:38 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.404s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:22:38 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img" returned: 0 in 7.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530a7c3-872c-4375-ac7e-f58a4c25c29c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:38 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:38 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:39 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.648s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:39 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Converted 1024.00 MB image at 137.45 MB/s Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] 6cfe260e-7b8b-4917-b521-108b15021709 was raw, converting to qcow2 {{(pid=87230) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c6598-a843-4ca9-b6d8-e2b329a57929]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:39 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img Nov 06 21:22:39 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:39 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img" returned: 0 in 0.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:39 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img Nov 06 21:22:39 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:40 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img" returned: 1 in 0.393s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img /opt/stack/data/cinder/conversion/vol_upload_midnhmht {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:40 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img /opt/stack/data/cinder/conversion/vol_upload_midnhmht Nov 06 21:22:40 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:40 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img /opt/stack/data/cinder/conversion/vol_upload_midnhmht" returned: 0 in 0.274s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Image conversion details: src /opt/stack/data/cinder/conversion/1d58c14b-fd8a-46e6-aec7-2eea03f35dd5.temp_image.6cfe260e-7b8b-4917-b521-108b15021709nu_2do2o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_midnhmht {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:40 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6129a62b-1628-466e-907c-7e6dc3c7e36c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_midnhmht {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:40 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_midnhmht Nov 06 21:22:40 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:40 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_midnhmht" returned: 0 in 0.342s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.062s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Uploaded volume to glance image-id: 6cfe260e-7b8b-4917-b521-108b15021709. {{(pid=87230) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.931s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ef12ba5-971f-4f29-893d-19e219928516,created_at=2026-11-06T20:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533729321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef12ba5-971f-4f29-893d-19e219928516,host='devstack@QuobyteHD#QuobyteHD',id=5a46fc7a-68c5-489b-9fc9-4d40435f349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:28Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c290c1b2-da7a-409f-81cb-3f833b461230),volume_type_id=c290c1b2-da7a-409f-81cb-3f833b461230)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Creating volume 5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:42 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:42 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a 1073741824 Nov 06 21:22:42 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-07e6cfe4-6812-48ae-bf57-01669d025f93 tempest-VolumesActionsTest-569089722 None] Copy volume to image completed successfully. Nov 06 21:22:42 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a 1073741824" returned: 0 in 0.480s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:42 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a Nov 06 21:22:42 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:43 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a" returned: 0 in 0.334s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.684s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770712e3-00a4-4803-a367-5bd7eeefc475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c14c94-82f8-452a-8d6d-c4194458709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Creating offline snapshot b7112f38-0da9-489e-ac1b-3093bead0da3 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eca5b6-3bc0-4a54-8688-04703fb0b105]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Volume volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a (5a46fc7a-68c5-489b-9fc9-4d40435f349a): created successfully Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c14c94-82f8-452a-8d6d-c4194458709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (6fc46d4a-9284-4b8c-9841-e29c45c27aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Flow 'volume_create_manager' (c3d8d06b-ac03-4c07-a9b6-94e681b5e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefc6bdd-958f-440d-915f-1fe1ffbd01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-abe959ca-3f8f-40ef-9771-60fc705ff08d tempest-GroupSnapshotsTest-1838131471 None] Created volume successfully. Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefc6bdd-958f-440d-915f-1fe1ffbd01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-587827643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a964b8d6-d62f-4663-86f5-f01730f8f9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4c783557f4a6795716cb31326f042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:43Z,use_quota=True,user_id='ef6e1315025248c38fd4c8803ee7e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:43 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781244b8-1857-498a-9482-4de8b4d12058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781244b8-1857-498a-9482-4de8b4d12058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb89233-fb10-473b-841c-69eb6bdd33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb89233-fb10-473b-841c-69eb6bdd33f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a964b8d6-d62f-4663-86f5-f01730f8f9fa', 'volume_name': 'volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ef885f-7e2e-4aa8-a79d-b77db55ae217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ef885f-7e2e-4aa8-a79d-b77db55ae217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdca66d-cdf7-4149-87e5-b104e975c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Volume a964b8d6-d62f-4663-86f5-f01730f8f9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa', 'volume_size': 1} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Acquiring lock "cinder-quobyte-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "cinder-quobyte-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[50886902-2956-4ff3-9002-3be3ba7740a9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:43 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:43 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 1G Nov 06 21:22:43 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:43 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:43 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.384s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5 Nov 06 21:22:44 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 1G" returned: 0 in 0.541s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 Nov 06 21:22:44 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" returned: 0 in 0.304s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "cinder-quobyte-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5" released by "delete_volume" :: held 0.752s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b6ad43ff-b11e-4a40-a54d-530b55645d21 tempest-GroupSnapshotsTest-1838131471 None] Update group completed successfully. Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Created reservations ['d8ad7b30-94ae-46ab-aee2-d4160a377676', 'acef4b02-8e5c-4d2a-a316-558e901fbdc8', 'e42518ab-cb2e-4985-938f-41fa5e1e57d7', 'a1b59f93-c643-47bc-b42e-c6cc7c133125'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:44 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 is being set with open permissions: ugo+rw Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:44 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 Nov 06 21:22:44 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:44 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.252s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Deleted volume successfully. Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-19bc9f71-f5ab-4e92-b075-6e68cc817d6f tempest-VolumesActionsTest-569089722 None] Lock "cinder-1d58c14b-fd8a-46e6-aec7-2eea03f35dd5-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:44 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3" returned: 0 in 0.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-587827643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a964b8d6-d62f-4663-86f5-f01730f8f9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4c783557f4a6795716cb31326f042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:43Z,use_quota=True,user_id='ef6e1315025248c38fd4c8803ee7e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Creating volume a964b8d6-d62f-4663-86f5-f01730f8f9fa {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:44 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:45 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa 1073741824 Nov 06 21:22:45 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f8d8622e-e468-4a45-a419-81614cb416b9 tempest-SnapshotsActionsTest-782655718 None] Create snapshot completed successfully Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-b7112f38-0da9-489e-ac1b-3093bead0da3-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-b7112f38-0da9-489e-ac1b-3093bead0da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-b7112f38-0da9-489e-ac1b-3093bead0da3" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-b7112f38-0da9-489e-ac1b-3093bead0da3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Deleting offline snapshot b7112f38-0da9-489e-ac1b-3093bead0da3 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] snapshot_file for this snap is: volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b183a-0c4e-4541-a10e-aba960c17cab]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:45 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa 1073741824" returned: 0 in 0.622s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:45 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 Nov 06 21:22:45 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:45 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa Nov 06 21:22:45 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86a7700f-80a3-4182-b8b4-b52dbe29352a tempest-GroupSnapshotsTest-1838131471 None] Update group completed successfully. Nov 06 21:22:45 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa" returned: 0 in 0.290s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdca66d-cdf7-4149-87e5-b104e975c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198be183-9995-41bf-a993-e99922b098cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:45 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3" returned: 0 in 0.485s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Volume volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa (a964b8d6-d62f-4663-86f5-f01730f8f9fa): created successfully Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198be183-9995-41bf-a993-e99922b098cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Flow 'volume_create_manager' (c3d8d06b-ac03-4c07-a9b6-94e681b5e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5865b-81a9-4294-a0b3-84fcdb3d646d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ba9ca5f3-fb61-4afe-8149-58a1d7a99473 tempest-VolumesTransfersTest-1163299354 None] Created volume successfully. Nov 06 21:22:46 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:46 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.478s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:46 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 Nov 06 21:22:46 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-33a3907e-37f0-46fc-8d65-4ad28bd4efee tempest-GroupSnapshotsTest-1838131471 None] Update group completed successfully. Nov 06 21:22:47 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3" returned: 0 in 0.518s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:47 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3 Nov 06 21:22:47 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-30991cd6-88bc-468a-af41-70a20ac46f38 tempest-VolumesTransfersTest-1909110564 None] Transfer volume completed successfully. Nov 06 21:22:47 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b7112f38-0da9-489e-ac1b-3093bead0da3" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-b7112f38-0da9-489e-ac1b-3093bead0da3" released by "_delete_snapshot" :: held 1.975s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_snapshot" :: held 2.015s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Created reservations ['f4811edc-41b1-40df-bd9d-0f8cbce6a9e6', 'b0fb613a-eb48-419c-9dfa-052c1b90469f', '60db97bf-d43e-46ef-b807-9907e1ceb06a', 'ca49f499-0a64-4386-bde0-773bbe837ede'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Delete snapshot completed successfully. Nov 06 21:22:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b7880dc-9639-453d-aaa9-f0745a8e1b76 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-b7112f38-0da9-489e-ac1b-3093bead0da3-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "cinder-a964b8d6-d62f-4663-86f5-f01730f8f9fa-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-a964b8d6-d62f-4663-86f5-f01730f8f9fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-bc04be48-6783-4c96-ab8a-4f5650b4cdf6 tempest-GroupSnapshotsTest-1838131471 None] Update group completed successfully. Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "cinder-quobyte-a964b8d6-d62f-4663-86f5-f01730f8f9fa" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-quobyte-a964b8d6-d62f-4663-86f5-f01730f8f9fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b413c915-fbfe-4551-a582-bfa440bcd2c8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa Nov 06 21:22:48 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:48 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa Nov 06 21:22:48 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:48 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a964b8d6-d62f-4663-86f5-f01730f8f9fa" returned: 0 in 0.412s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-quobyte-a964b8d6-d62f-4663-86f5-f01730f8f9fa" released by "delete_volume" :: held 0.902s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Creating offline snapshot aaa2a58c-a610-45cf-971a-3821f550614a of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Created reservations ['744e249d-9fb4-46e6-8234-6db2841895a1', '7b0af12c-a86a-41d2-a4f6-2f5018374983', '9280e091-d9ee-4a6e-8e12-62ddcc32c06a', '9a3e50e8-1bff-4377-9782-46421a3dddee'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294b392-c665-47f9-86f5-8e8d796dc2cb]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:49 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:49 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.341s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Deleted volume successfully. Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f296113b-d407-4a58-b50c-ec40d1a0226e tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-a964b8d6-d62f-4663-86f5-f01730f8f9fa-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:49 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.497s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] GroupSnapshot 6561079b-0006-484a-877f-ec50d267eaf2: creating. Nov 06 21:22:49 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a 1G Nov 06 21:22:49 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Group snapshot 6561079b-0006-484a-877f-ec50d267eaf2: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:22:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:50 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a 1G" returned: 0 in 0.537s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:50 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a Nov 06 21:22:50 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:50 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a" returned: 0 in 0.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a is being set with open permissions: ugo+rw Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:50 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a Nov 06 21:22:50 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:50 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a" returned: 0 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.234s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Flow 'volume_create_manager' (f8f2c733-149f-4654-b6d6-f231b16c69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5149d318-4d4d-453e-889f-dba6707aba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Creating offline snapshot 23918439-0325-4db1-bf45-2feaefc9814d of volume 5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5149d318-4d4d-453e-889f-dba6707aba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-457997460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd65205-4e4b-426a-bb7f-e5082267bca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4c783557f4a6795716cb31326f042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:51Z,use_quota=True,user_id='ef6e1315025248c38fd4c8803ee7e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8654d2ae-1e20-4065-b8f8-16acf26f0012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8654d2ae-1e20-4065-b8f8-16acf26f0012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1957406c-5629-4c32-88bb-1fa8670f39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1957406c-5629-4c32-88bb-1fa8670f39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd65205-4e4b-426a-bb7f-e5082267bca5', 'volume_name': 'volume-1bd65205-4e4b-426a-bb7f-e5082267bca5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387dffe-836c-4292-af80-0ec85a6d13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387dffe-836c-4292-af80-0ec85a6d13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06266441-4cfc-4211-9ae3-568cd08df9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Volume 1bd65205-4e4b-426a-bb7f-e5082267bca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd65205-4e4b-426a-bb7f-e5082267bca5', 'volume_size': 1} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51935d-f2ee-4ec7-b08f-e96141a5b20c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a395690b-57e8-45dc-89bc-dd8305f6f611 tempest-SnapshotsActionsTest-782655718 None] Create snapshot completed successfully Nov 06 21:22:51 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a Nov 06 21:22:51 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-aaa2a58c-a610-45cf-971a-3821f550614a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-aaa2a58c-a610-45cf-971a-3821f550614a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-aaa2a58c-a610-45cf-971a-3821f550614a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-aaa2a58c-a610-45cf-971a-3821f550614a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Deleting offline snapshot aaa2a58c-a610-45cf-971a-3821f550614a of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] snapshot_file for this snap is: volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b88133-7df6-4f3a-8d2b-bad2ff561034]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a" returned: 0 in 0.407s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a Nov 06 21:22:51 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d 1G Nov 06 21:22:51 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a" returned: 0 in 0.387s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187d5f3-7720-4b28-b97e-f7a697cb8fdd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:51 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:51 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:51 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d 1G" returned: 0 in 0.498s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d Nov 06 21:22:52 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.414s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a Nov 06 21:22:52 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d Nov 06 21:22:52 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info Nov 06 21:22:52 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a" returned: 0 in 0.456s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a Nov 06 21:22:52 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:52 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:52 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info Nov 06 21:22:52 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.aaa2a58c-a610-45cf-971a-3821f550614a" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-aaa2a58c-a610-45cf-971a-3821f550614a" released by "_delete_snapshot" :: held 1.685s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_snapshot" :: held 1.716s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Created reservations ['ec4dff8e-03ae-4c76-ba6f-ba40cb0ac7bc', '31d40576-ad6c-4eb1-a940-14969f59a05e', '6310928b-6d74-40d4-9d7a-d320cceae9aa', '40fba8c5-42d0-4ad1-bd18-ff8ea8cffeee'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Delete snapshot completed successfully. Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ee42974b-8b97-4f16-93b2-e53516aa477d tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-aaa2a58c-a610-45cf-971a-3821f550614a-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:53 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.info" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Creating offline snapshot cd988f4e-264d-4e8a-8c9d-cef938be3676 of volume 88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[022538c9-5ece-4ee7-95fa-c2ba9a182f6f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 Nov 06 21:22:53 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Flow 'volume_create_manager' (14f5acfc-b369-4c73-bb08-172fbc38f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c233617-2b65-454d-95e8-156f40c7c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c233617-2b65-454d-95e8-156f40c7c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-935719608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c5c64-e01b-46f0-b8e9-61af8eccc01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d0e3399a1b4003b4ba4e21ffa6e601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:54Z,use_quota=True,user_id='20897f84219943beb4471b7bb4e4032f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3788c71a-652d-4c2b-8563-18df1310ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3788c71a-652d-4c2b-8563-18df1310ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc7dae3-0038-49ec-becf-3ffed6925edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc7dae3-0038-49ec-becf-3ffed6925edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'volume_name': 'volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6681273-d24d-4655-ad0b-2ae0c98f66a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6681273-d24d-4655-ad0b-2ae0c98f66a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c848a276-2657-4037-9106-8c4d0453eda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Volume 395c5c64-e01b-46f0-b8e9-61af8eccc01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'volume_size': 1} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:53 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2" returned: 0 in 0.435s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:53 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 1G Nov 06 21:22:53 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:54 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 1G" returned: 0 in 0.428s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248c6a-6630-44e1-9962-492e4c870fc2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248c6a-6630-44e1-9962-492e4c870fc2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 Nov 06 21:22:54 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248c6a-6630-44e1-9962-492e4c870fc2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 Nov 06 21:22:54 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676" returned: 0 in 0.229s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:54 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info Nov 06 21:22:54 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:54 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:54 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info Nov 06 21:22:55 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.info" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.176s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-457997460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd65205-4e4b-426a-bb7f-e5082267bca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac4c783557f4a6795716cb31326f042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:51Z,use_quota=True,user_id='ef6e1315025248c38fd4c8803ee7e9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Creating volume 1bd65205-4e4b-426a-bb7f-e5082267bca5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 1073741824 Nov 06 21:22:55 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fb8ec75d-c706-44aa-94dd-a95817b62ad5 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot 6561079b-0006-484a-877f-ec50d267eaf2: created successfully Nov 06 21:22:55 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 1073741824" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 Nov 06 21:22:55 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:55 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.328s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-935719608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c5c64-e01b-46f0-b8e9-61af8eccc01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d0e3399a1b4003b4ba4e21ffa6e601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:54Z,use_quota=True,user_id='20897f84219943beb4471b7bb4e4032f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Creating volume 395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:56 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06266441-4cfc-4211-9ae3-568cd08df9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd65205-4e4b-426a-bb7f-e5082267bca5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3034fb-eca4-47aa-bb2b-d3e1b12e0d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:56 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e 1073741824 Nov 06 21:22:56 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Volume volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 (1bd65205-4e4b-426a-bb7f-e5082267bca5): created successfully Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3034fb-eca4-47aa-bb2b-d3e1b12e0d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Flow 'volume_create_manager' (f8f2c733-149f-4654-b6d6-f231b16c69de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d1b80225-aa05-48e6-9900-75aed7ad8c0a tempest-VolumesTransfersTest-1163299354 None] Created volume successfully. Nov 06 21:22:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot 6561079b-0006-484a-877f-ec50d267eaf2: deleting Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot 6561079b-0006-484a-877f-ec50d267eaf2: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-23918439-0325-4db1-bf45-2feaefc9814d" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-23918439-0325-4db1-bf45-2feaefc9814d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Deleting offline snapshot 23918439-0325-4db1-bf45-2feaefc9814d of volume 5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] snapshot_file for this snap is: volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d695e58-56f7-4e3f-aebf-542a4547678a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d Nov 06 21:22:56 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "cinder-1bd65205-4e4b-426a-bb7f-e5082267bca5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:56 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e 1073741824" returned: 0 in 0.563s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-1bd65205-4e4b-426a-bb7f-e5082267bca5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "cinder-quobyte-1bd65205-4e4b-426a-bb7f-e5082267bca5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:56 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:22:56 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-quobyte-1bd65205-4e4b-426a-bb7f-e5082267bca5" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[182dfa2c-bf28-46ef-9dfc-c5117ca4a848]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f89d6-4e6b-4ad9-98ac-2d6f5d47eae3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 Nov 06 21:22:56 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a Nov 06 21:22:56 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.125s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c848a276-2657-4037-9106-8c4d0453eda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3de4c3-607d-4cb8-83da-8a103ea817c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Creating offline snapshot b29c93b3-d82b-4e81-a2e1-62f227cee1a9 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Volume volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e (395c5c64-e01b-46f0-b8e9-61af8eccc01e): created successfully Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3de4c3-607d-4cb8-83da-8a103ea817c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Flow 'volume_create_manager' (14f5acfc-b369-4c73-bb08-172fbc38f251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45623bba-a93c-4808-bff4-085fce169b82]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5f55006c-dcb9-4d8d-a7e0-5350696fc919 tempest-VolumesCloneTest-53740868 None] Created volume successfully. Nov 06 21:22:57 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5" returned: 0 in 0.430s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5 Nov 06 21:22:57 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:22:57 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d Nov 06 21:22:57 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1bd65205-4e4b-426a-bb7f-e5082267bca5" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-quobyte-1bd65205-4e4b-426a-bb7f-e5082267bca5" released by "delete_volume" :: held 0.750s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:57 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 1G Nov 06 21:22:57 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Created reservations ['1707c013-b715-446f-8c83-00faa2be4dce', '1ee8af85-d62c-440f-b225-027788d402dc', '22c5c849-4fc7-4bba-a1fe-72cec6aa7d36', 'c4ce677e-7874-4b0e-9732-97dafc8fe10b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:22:57 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d" returned: 0 in 0.410s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d Nov 06 21:22:57 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:57 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Deleted volume successfully. Nov 06 21:22:58 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a.23918439-0325-4db1-bf45-2feaefc9814d" returned: 0 in 0.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-23918439-0325-4db1-bf45-2feaefc9814d" released by "_delete_snapshot" :: held 1.779s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-033c6f0b-c353-48b3-8d79-6fb7027bbe12 tempest-VolumesTransfersTest-2047820601 None] Lock "cinder-1bd65205-4e4b-426a-bb7f-e5082267bca5-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" released by "delete_snapshot" :: held 1.817s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-cd988f4e-264d-4e8a-8c9d-cef938be3676" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:58 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 1G" returned: 0 in 0.652s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-cd988f4e-264d-4e8a-8c9d-cef938be3676" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Deleting offline snapshot cd988f4e-264d-4e8a-8c9d-cef938be3676 of volume 88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:58 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 Nov 06 21:22:58 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] snapshot_file for this snap is: volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2619b05-f871-47a9-9aa6-290df177a99d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 Nov 06 21:22:58 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9" returned: 0 in 0.418s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 is being set with open permissions: ugo+rw Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 Nov 06 21:22:58 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Flow 'volume_create_manager' (b8486c2d-5083-47f1-bb4e-02cc8400141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaae21-85cd-4123-abe5-e88f9aabae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaae21-85cd-4123-abe5-e88f9aabae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1744013905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29726f0e-b10d-4f6d-9a5a-28eb6673f15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d0e3399a1b4003b4ba4e21ffa6e601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=395c5c64-e01b-46f0-b8e9-61af8eccc01e,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:59Z,use_quota=True,user_id='20897f84219943beb4471b7bb4e4032f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2db32e2-ec21-4759-bad3-133a61e742a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2db32e2-ec21-4759-bad3-133a61e742a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9089e946-bfb4-4c6a-8d08-3dd9a95ab640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676" returned: 0 in 0.526s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88248c6a-6630-44e1-9962-492e4c870fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9089e946-bfb4-4c6a-8d08-3dd9a95ab640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '29726f0e-b10d-4f6d-9a5a-28eb6673f15b', 'volume_name': 'volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b', 'volume_size': 2, 'source_volid': '395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aeee1a-04aa-4a5d-85c8-4b70e7bde56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aeee1a-04aa-4a5d-85c8-4b70e7bde56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4bc482-ea95-44bf-9864-8452e96db36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Volume 29726f0e-b10d-4f6d-9a5a-28eb6673f15b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b', 'volume_size': 2, 'source_volid': '395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'source_volstatus': 'available'} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4857d4f7-089c-4903-a9ef-974ff88aa796]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:58 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.098s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:58 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Cloning volume 395c5c64-e01b-46f0-b8e9-61af8eccc01e to volume 29726f0e-b10d-4f6d-9a5a-28eb6673f15b Nov 06 21:22:58 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 Nov 06 21:22:58 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fbae6212-df27-484c-936c-7a72cf7819c0 tempest-SnapshotsActionsTest-782655718 None] Create snapshot completed successfully Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Creating offline snapshot 2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 of volume 395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:22:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9264c00d-1cb8-479c-a425-aa911512fb85]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:22:59 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-b29c93b3-d82b-4e81-a2e1-62f227cee1a9-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-b29c93b3-d82b-4e81-a2e1-62f227cee1a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-b29c93b3-d82b-4e81-a2e1-62f227cee1a9" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-b29c93b3-d82b-4e81-a2e1-62f227cee1a9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:59 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Deleting offline snapshot b29c93b3-d82b-4e81-a2e1-62f227cee1a9 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] snapshot_file for this snap is: volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2" returned: 0 in 0.552s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2076b8ca-afe4-4435-a797-d2dc77b9785a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 Nov 06 21:22:59 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.465s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 Nov 06 21:22:59 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 1G Nov 06 21:22:59 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676" returned: 0 in 0.461s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9" returned: 0 in 0.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:59 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676 Nov 06 21:22:59 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916bc23-8b79-4dee-9359-e99b6146f6ab]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 1G" returned: 0 in 0.514s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:00 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:00 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2.cd988f4e-264d-4e8a-8c9d-cef938be3676" returned: 0 in 0.317s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-cd988f4e-264d-4e8a-8c9d-cef938be3676" released by "_delete_snapshot" :: held 2.014s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" released by "delete_snapshot" :: held 2.061s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:00 devstack cinder-volume[87230]: WARNING cinder.quota [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-885611725 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-885611725, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:00 devstack cinder-volume[87230]: WARNING cinder.quota [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-885611725 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-885611725, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['2c2ee401-dd98-44c9-8598-4478af45138f', '23c43520-fce7-4be5-9e1b-4dfa040cea3d', '9bf734c3-d4da-47d2-97a2-8159c59984ac', 'e0724537-292f-4fe3-82a8-7e3c7e689056'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:00 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 is being set with open permissions: ugo+rw Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:00 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.601s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 Nov 06 21:23:00 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['dddc9ba7-76ec-48cb-8e29-7fee464a6993', '10c25853-619f-4c5a-b12e-fd71574d6800', 'f24e4a8e-0d9a-4008-9c52-4459a37e4f2a', '679cbee3-505c-4998-8216-1a1a940faaa5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-781b0902-9e4f-4b0d-89d0-64756152f627 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot 6561079b-0006-484a-877f-ec50d267eaf2: deleted successfully Nov 06 21:23:00 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.407s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info Nov 06 21:23:00 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9" returned: 0 in 0.567s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:01 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9 Nov 06 21:23:01 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info" returned: 0 in 0.302s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info is being set with open permissions: ugo+rw Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:01 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info Nov 06 21:23:01 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.b29c93b3-d82b-4e81-a2e1-62f227cee1a9" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.info" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-b29c93b3-d82b-4e81-a2e1-62f227cee1a9" released by "_delete_snapshot" :: held 2.142s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_snapshot" :: held 2.176s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] snapshot: 2e728b0f-b4f1-4090-8d8b-661b0d0d39e9, volume: 29726f0e-b10d-4f6d-9a5a-28eb6673f15b, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b38e0-c347-4e76-9b2a-f82f80a53400]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Created reservations ['1e5e86fb-d36d-4a3b-913c-a661c34251a9', '49627922-5f65-4243-bc2d-fd924c13c9fa', 'dda69e9b-3828-4f6b-869e-d75dcfc0ab42', '9c4704c9-1c21-4efd-a0c7-4f9145c2459d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Delete snapshot completed successfully. Nov 06 21:23:01 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d04af30-e4d2-41c5-85c2-4b2fb3353636 tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-b29c93b3-d82b-4e81-a2e1-62f227cee1a9-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:01 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187957b-c753-4583-acec-2a0b23b091ac]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:23:02 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7840e083-3bf7-4233-8c7d-df54407cef87]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a Nov 06 21:23:02 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:02 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b Nov 06 21:23:02 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:02 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a" returned: 0 in 0.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a Nov 06 21:23:02 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:03 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5a46fc7a-68c5-489b-9fc9-4d40435f349a" returned: 0 in 0.514s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-5a46fc7a-68c5-489b-9fc9-4d40435f349a" released by "delete_volume" :: held 1.238s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab6bf0-e908-4683-9034-9285dd2f5b8a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:03 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 Nov 06 21:23:03 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:04 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2" returned: 0 in 0.712s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:04 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2 Nov 06 21:23:04 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:04 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-88248c6a-6630-44e1-9962-492e4c870fc2" returned: 0 in 0.444s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-88248c6a-6630-44e1-9962-492e4c870fc2" released by "delete_volume" :: held 1.398s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['a0fd6030-1e35-4f13-90d9-10ec877bb748'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:05 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-885611725 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-885611725, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['96438859-cacb-434f-919d-c9b1e465bc7a', 'eefeab75-12c3-42a7-a008-de866d6f4c10', '9fdc1a75-469a-4e99-8caa-fc16c9760f10', '6454b304-415d-4676-95cd-e40ee4dd0b97'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['c2e0d501-e32e-42fd-a03c-a5a43f15a886', '929b1d0b-4d58-49d3-8074-7684b95883cc', 'f1ba24f5-da82-4471-809a-9a581c24a5b9', '701717d5-061a-4749-bae6-ab3d502cbd28'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:05 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:05 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:06 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.543s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1e973cce-9bf6-4aae-88e3-bbc08529e710 tempest-GroupSnapshotsTest-1838131471 None] Delete group completed successfully. Nov 06 21:23:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-19149b49-a8f5-46f7-830c-9a745a38e0bb tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-1606600649: creating Nov 06 21:23:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-19149b49-a8f5-46f7-830c-9a745a38e0bb tempest-GroupSnapshotsTest-1838131471 None] Group tempest-GroupSnapshotsTest-Group-1606600649: created successfully Nov 06 21:23:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-19149b49-a8f5-46f7-830c-9a745a38e0bb tempest-GroupSnapshotsTest-1838131471 None] Create group completed successfully. Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Flow 'volume_create_manager' (92ca9409-9781-49eb-a0ba-e932fa17ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f600e7-d1a2-44aa-854a-5add8173a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f600e7-d1a2-44aa-854a-5add8173a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1475942918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc513e5a-4b53-4593-acec-6fc438a2311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597bf650fe846378958b75a714009c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='8d7de20216e24e789ac2b8eee2f13e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db037fa3-d213-4972-90ba-9d28add3cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db037fa3-d213-4972-90ba-9d28add3cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e5d58e-0b06-42ec-b52e-9fa193f0f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e5d58e-0b06-42ec-b52e-9fa193f0f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc513e5a-4b53-4593-acec-6fc438a2311f', 'volume_name': 'volume-fc513e5a-4b53-4593-acec-6fc438a2311f', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40950a8a-7564-4538-99c6-1ab9bb058cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40950a8a-7564-4538-99c6-1ab9bb058cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb920ca-a9c8-4103-8171-f8076f148eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Volume fc513e5a-4b53-4593-acec-6fc438a2311f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc513e5a-4b53-4593-acec-6fc438a2311f', 'volume_size': 2} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (e72c213b-538f-4d9e-9d1c-e82200ead009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867e37f7-8915-47d7-a008-3248a751a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867e37f7-8915-47d7-a008-3248a751a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-848242517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f77054-f1e7-493b-ae88-9a823af361ce,host='devstack@QuobyteHD#QuobyteHD',id=de0ab55b-a760-40bd-91a2-284299377cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:10Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3436ecfd-23bb-4647-81ef-3b14e931e96c),volume_type_id=3436ecfd-23bb-4647-81ef-3b14e931e96c)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc181ff3-7ddc-4d16-9710-5db580ab7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc181ff3-7ddc-4d16-9710-5db580ab7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbbe2d0-4daa-43fb-8baa-d40393c41d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbbe2d0-4daa-43fb-8baa-d40393c41d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0ab55b-a760-40bd-91a2-284299377cd0', 'volume_name': 'volume-de0ab55b-a760-40bd-91a2-284299377cd0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a60e872-ffc8-433f-aa26-15bf94bdc2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a60e872-ffc8-433f-aa26-15bf94bdc2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1251198f-77c0-45b4-b60a-e03a51a2611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Volume de0ab55b-a760-40bd-91a2-284299377cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0ab55b-a760-40bd-91a2-284299377cd0', 'volume_size': 1} Nov 06 21:23:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:11 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" returned: 0 in 8.509s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:23:11 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Converted 1024.00 MB image at 120.33 MB/s Nov 06 21:23:11 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b is being set with open permissions: ugo+rw Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b Nov 06 21:23:11 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" returned: 0 in 0.239s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" released by "_copy_volume_from_snapshot" :: held 9.805s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-quobyte-2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Deleting offline snapshot 2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 of volume 395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] snapshot_file for this snap is: volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5552e03-6e28-4638-bdd1-f279ebb6438c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:11 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.387s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a1afdc-07b3-4d29-bb06-46703589b1c4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:23:11 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.548s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:12 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.335s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9 Nov 06 21:23:12 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e.2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-2e728b0f-b4f1-4090-8d8b-661b0d0d39e9" released by "_delete_snapshot" :: held 1.631s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.058s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.947s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Creating offline snapshot f68f9789-d064-4003-b5f6-50b3fbdd6a05 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4bc482-ea95-44bf-9864-8452e96db36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b', 'volume_size': 2, 'source_volid': '395c5c64-e01b-46f0-b8e9-61af8eccc01e', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213753be-b396-4758-a6b2-81128227475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b91039-e47e-4d7b-8f1b-4111ccebedd2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Volume volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b (29726f0e-b10d-4f6d-9a5a-28eb6673f15b): created successfully Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213753be-b396-4758-a6b2-81128227475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Flow 'volume_create_manager' (b8486c2d-5083-47f1-bb4e-02cc8400141d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-293eb1d0-e693-4b8b-9a6c-8eea0ba63b82 tempest-VolumesCloneTest-53740868 None] Created volume successfully. Nov 06 21:23:13 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:13 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:13 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.384s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:13 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 1G Nov 06 21:23:13 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:13 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 1G" returned: 0 in 0.489s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:13 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 Nov 06 21:23:13 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:14 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 is being set with open permissions: ugo+rw Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 Nov 06 21:23:14 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-29726f0e-b10d-4f6d-9a5a-28eb6673f15b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "cinder-29726f0e-b10d-4f6d-9a5a-28eb6673f15b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[782331fb-cd09-4370-96ad-b8583fc2ae16]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b Nov 06 21:23:14 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.651s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1475942918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc513e5a-4b53-4593-acec-6fc438a2311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8597bf650fe846378958b75a714009c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='8d7de20216e24e789ac2b8eee2f13e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Creating volume fc513e5a-4b53-4593-acec-6fc438a2311f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f 2147483648 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f 2147483648 Nov 06 21:23:14 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d20fff5e-6763-47d2-b0de-91d5b9a35ea8 tempest-SnapshotsActionsTest-782655718 None] Create snapshot completed successfully Nov 06 21:23:14 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b Nov 06 21:23:14 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-f68f9789-d064-4003-b5f6-50b3fbdd6a05-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-f68f9789-d064-4003-b5f6-50b3fbdd6a05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:15 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" returned: 0 in 0.304s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Acquiring lock "cinder-quobyte-f68f9789-d064-4003-b5f6-50b3fbdd6a05" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-29726f0e-b10d-4f6d-9a5a-28eb6673f15b" released by "delete_volume" :: held 0.800s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-f68f9789-d064-4003-b5f6-50b3fbdd6a05" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Deleting offline snapshot f68f9789-d064-4003-b5f6-50b3fbdd6a05 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] snapshot_file for this snap is: volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be2361c-5073-470c-ac40-924116771f28]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f 2147483648" returned: 0 in 0.619s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Created reservations ['9736321a-25ee-49a7-8b0c-7128a47eb5b3', 'a101724a-522c-4aef-a90e-a11fa124d25b', '048b20d5-d326-4e82-acc5-56580904fbcb', 'c0c0cecf-34d3-4624-abdc-ef697d07c072'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f Nov 06 21:23:15 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 Nov 06 21:23:15 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:15 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-395c5c64-e01b-46f0-b8e9-61af8eccc01e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "cinder-395c5c64-e01b-46f0-b8e9-61af8eccc01e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Acquiring lock "cinder-quobyte-395c5c64-e01b-46f0-b8e9-61af8eccc01e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:15 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05" returned: 0 in 0.488s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:15 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-395c5c64-e01b-46f0-b8e9-61af8eccc01e" acquired by "delete_volume" :: waited 0.061s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[298bb721-8b19-48fe-9c93-24cc83a34d58]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9a0cd-0b8a-4469-86ce-a91af4be62e2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.749s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19f77054-f1e7-493b-ae88-9a823af361ce,created_at=2026-11-06T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-848242517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f77054-f1e7-493b-ae88-9a823af361ce,host='devstack@QuobyteHD#QuobyteHD',id=de0ab55b-a760-40bd-91a2-284299377cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b770106405843e3bf9c5c33a32c490e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:10Z,use_quota=True,user_id='f2dda74b6c6649a1bc0eeb2a8328da1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3436ecfd-23bb-4647-81ef-3b14e931e96c),volume_type_id=3436ecfd-23bb-4647-81ef-3b14e931e96c)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Creating volume de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 1073741824 Nov 06 21:23:15 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Deleted volume successfully. Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb920ca-a9c8-4103-8171-f8076f148eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc513e5a-4b53-4593-acec-6fc438a2311f', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2e238d-c1ac-48a5-88bb-500e6155d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Volume volume-fc513e5a-4b53-4593-acec-6fc438a2311f (fc513e5a-4b53-4593-acec-6fc438a2311f): created successfully Nov 06 21:23:15 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2e238d-c1ac-48a5-88bb-500e6155d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:15 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Flow 'volume_create_manager' (92ca9409-9781-49eb-a0ba-e932fa17ee58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97fd3b3e-47e9-41cb-a92d-9b09fb0b4d1f tempest-VolumesCloneTest-53740868 None] Lock "cinder-29726f0e-b10d-4f6d-9a5a-28eb6673f15b-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-69ec2cd9-8f51-4783-9f6e-74ebbe043e0b tempest-VolumesCloneNegativeTest-1466730756 None] Created volume successfully. Nov 06 21:23:16 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:23:16 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.430s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 Nov 06 21:23:16 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e Nov 06 21:23:16 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 1073741824" returned: 0 in 0.621s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 Nov 06 21:23:16 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-395c5c64-e01b-46f0-b8e9-61af8eccc01e" returned: 0 in 0.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Acquiring lock "cinder-fc513e5a-4b53-4593-acec-6fc438a2311f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "cinder-quobyte-395c5c64-e01b-46f0-b8e9-61af8eccc01e" released by "delete_volume" :: held 0.888s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "cinder-fc513e5a-4b53-4593-acec-6fc438a2311f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Acquiring lock "cinder-quobyte-fc513e5a-4b53-4593-acec-6fc438a2311f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Created reservations ['94fcb760-4de2-4bcc-a7a0-40d06e42e71a', '35128725-0102-46c7-8b8b-d6c2785051c9', 'f2ab4c6d-cebc-43ce-835c-012e87133d4c', '811876e2-cd69-4c7e-bda0-08fc365665b3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "cinder-quobyte-fc513e5a-4b53-4593-acec-6fc438a2311f" acquired by "delete_volume" :: waited 0.049s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:16 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05" returned: 0 in 0.622s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0" returned: 0 in 0.348s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c085b61-47bd-415c-a2aa-8ab3ba4a4f97]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05 Nov 06 21:23:16 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1251198f-77c0-45b4-b60a-e03a51a2611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0ab55b-a760-40bd-91a2-284299377cd0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227abb89-22de-4e7f-88be-08f351e18722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Volume volume-de0ab55b-a760-40bd-91a2-284299377cd0 (de0ab55b-a760-40bd-91a2-284299377cd0): created successfully Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227abb89-22de-4e7f-88be-08f351e18722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Flow 'volume_create_manager' (e72c213b-538f-4d9e-9d1c-e82200ead009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-21381e5b-760a-4e6a-8b78-d7e8e742d1f7 tempest-GroupSnapshotsTest-1838131471 None] Created volume successfully. Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:17 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f Nov 06 21:23:17 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:17 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:17 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:17 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.f68f9789-d064-4003-b5f6-50b3fbdd6a05" returned: 0 in 0.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-f68f9789-d064-4003-b5f6-50b3fbdd6a05" released by "_delete_snapshot" :: held 2.059s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_snapshot" :: held 2.095s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:17 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.300s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Deleted volume successfully. Nov 06 21:23:17 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f" returned: 0 in 0.448s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:17 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f Nov 06 21:23:17 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8a9fa168-0079-4f45-b9de-9042b95dbe18 tempest-VolumesCloneTest-53740868 None] Lock "cinder-395c5c64-e01b-46f0-b8e9-61af8eccc01e-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Created reservations ['131ca061-9fba-4916-ade7-6175dcbbcb04', 'e7e77a2b-fb8f-43b7-9f53-482b16e04bb1', '8259dbd6-9249-42d8-8e6f-8b862a5f7a76', 'c0710f2c-a6a7-47ef-aeaa-7eff3b9d5372'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Delete snapshot completed successfully. Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-16901321-7faa-4a88-aea1-31034a4d4d5e tempest-SnapshotsActionsTest-1257362339 None] Lock "cinder-f68f9789-d064-4003-b5f6-50b3fbdd6a05-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:17 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fc513e5a-4b53-4593-acec-6fc438a2311f" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "cinder-quobyte-fc513e5a-4b53-4593-acec-6fc438a2311f" released by "delete_volume" :: held 0.781s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Created reservations ['df9cf617-141b-472b-9b70-4f004224fc6a', '3940e074-21b9-477e-a15d-372cd18a57a3', '943aa424-5bd3-488e-acc4-d8e92c7115cd', '79727e00-d9db-4d2b-b594-a99ee6f36007'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:17 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:17 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:17 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Deleted volume successfully. Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5d77bb7d-e7ac-4f7f-ad8c-9a127cf9700c tempest-VolumesCloneNegativeTest-1466730756 None] Lock "cinder-fc513e5a-4b53-4593-acec-6fc438a2311f-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] GroupSnapshot dc857a37-1f38-454d-b963-7777161b4630: creating. Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Group snapshot dc857a37-1f38-454d-b963-7777161b4630: creating. {{(pid=87230) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Creating offline snapshot b7e6bbbb-7e07-4925-807e-759c67557d8a of volume de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414e398-3234-4a59-9763-c58cee256e0b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:18 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 Nov 06 21:23:18 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a 1G Nov 06 21:23:19 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "cinder-2bb8a76e-7417-4c1d-9041-c87472c618c8-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-2bb8a76e-7417-4c1d-9041-c87472c618c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "cinder-quobyte-2bb8a76e-7417-4c1d-9041-c87472c618c8" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-2bb8a76e-7417-4c1d-9041-c87472c618c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Deleting offline snapshot 2bb8a76e-7417-4c1d-9041-c87472c618c8 of volume d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] snapshot_file for this snap is: volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e86863-4c18-4e13-a94f-17b472535a78]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:19 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a 1G" returned: 0 in 0.597s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0ab55b-a760-40bd-91a2-284299377cd0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0ab55b-a760-40bd-91a2-284299377cd0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a Nov 06 21:23:19 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2ddb660-dea3-478e-9033-251d61f9d293(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45409e-a7cb-4b53-9347-fc4c30802f07]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0ab55b-a760-40bd-91a2-284299377cd0 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 Nov 06 21:23:20 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a Nov 06 21:23:20 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=148,cinder:SELECT=146,cinder:INSERT=47,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=137,cinder:UPDATE=165,cinder:DELETE=10,cinder:INSERT=41 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293" returned: 0 in 0.491s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info Nov 06 21:23:20 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:20 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info" returned: 0 in 0.293s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:23:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info Nov 06 21:23:20 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:21 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:21 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8 Nov 06 21:23:21 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:21 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.info" returned: 0 in 0.287s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-62e794b1-7bac-4d91-87a7-d757c3feeb97 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot dc857a37-1f38-454d-b963-7777161b4630: created successfully Nov 06 21:23:21 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293.2bb8a76e-7417-4c1d-9041-c87472c618c8" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-2bb8a76e-7417-4c1d-9041-c87472c618c8" released by "_delete_snapshot" :: held 1.932s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_snapshot" :: held 1.960s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Created reservations ['a03c38d5-c11c-4653-871d-a835791cefc9', '5375ea00-c568-4213-a595-233c7591b4a3', '1a5448c3-a651-42b0-a62f-72cb26270a74', '3ac5ac12-6947-4cab-ac2a-e2a418061f2d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Delete snapshot completed successfully. Nov 06 21:23:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f87e04b0-c837-4384-baab-87e28ed868a6 tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-2bb8a76e-7417-4c1d-9041-c87472c618c8-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot dc857a37-1f38-454d-b963-7777161b4630: deleting Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot dc857a37-1f38-454d-b963-7777161b4630: deleting {{(pid=87230) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-b7e6bbbb-7e07-4925-807e-759c67557d8a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-b7e6bbbb-7e07-4925-807e-759c67557d8a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Deleting offline snapshot b7e6bbbb-7e07-4925-807e-759c67557d8a of volume de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] snapshot_file for this snap is: volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192756c-355e-4fc5-af08-74ea9104e328]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:22 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a Nov 06 21:23:22 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:22 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a" returned: 0 in 0.448s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0ab55b-a760-40bd-91a2-284299377cd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a6ede-b206-49a8-bd79-c58d2b09070e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "cinder-d2ddb660-dea3-478e-9033-251d61f9d293-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-d2ddb660-dea3-478e-9033-251d61f9d293-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:22 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 Nov 06 21:23:22 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[16402876-c642-417a-8885-ccf96acaa836]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:22 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 Nov 06 21:23:22 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:23 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0" returned: 0 in 0.459s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a Nov 06 21:23:23 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:23 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293" returned: 0 in 0.429s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293 Nov 06 21:23:23 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:23 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a" returned: 0 in 0.454s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a Nov 06 21:23:23 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:23 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d2ddb660-dea3-478e-9033-251d61f9d293" returned: 0 in 0.415s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-quobyte-d2ddb660-dea3-478e-9033-251d61f9d293" released by "delete_volume" :: held 0.942s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Created reservations ['cde87666-4064-4367-a551-9dace2f20d8f', 'f751a695-ceda-44f7-8737-8e989a8678a7', '0bd590ae-5a3b-4740-9300-55ac1b824077', '5aa97ebe-7578-41dc-a737-0836013a90a2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (f3d0a4a4-5f2c-40da-8cdb-ecefe8771fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9fd2b-c114-4f93-9ac7-ddc5ecf2cfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:23 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0.b7e6bbbb-7e07-4925-807e-759c67557d8a" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d9fd2b-c114-4f93-9ac7-ddc5ecf2cfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2130223617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fa29dc-841d-4a33-9123-ef0e04193284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:24Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe93ada-c307-49b0-bdf3-26d961cda0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe93ada-c307-49b0-bdf3-26d961cda0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92d3ff0-8d7b-4526-82cf-74204c0c1c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92d3ff0-8d7b-4526-82cf-74204c0c1c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fa29dc-841d-4a33-9123-ef0e04193284', 'volume_name': 'volume-95fa29dc-841d-4a33-9123-ef0e04193284', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee2507-d9e1-4131-a73f-716082d89473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee2507-d9e1-4131-a73f-716082d89473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a5db11-1d05-470f-aca4-4f0b3d040b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Volume 95fa29dc-841d-4a33-9123-ef0e04193284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fa29dc-841d-4a33-9123-ef0e04193284', 'volume_size': 1} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2130223617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fa29dc-841d-4a33-9123-ef0e04193284,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:24Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Creating volume 95fa29dc-841d-4a33-9123-ef0e04193284 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:23 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-b7e6bbbb-7e07-4925-807e-759c67557d8a" released by "_delete_snapshot" :: held 1.920s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" released by "delete_snapshot" :: held 1.950s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:24 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 1073741824 Nov 06 21:23:24 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:24 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:24 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack cinder-volume[87230]: WARNING cinder.quota [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1994749434 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1994749434, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:24 devstack cinder-volume[87230]: WARNING cinder.quota [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1994749434 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1994749434, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['604bcbd8-9871-49cf-9b30-d8bab28a58c9', 'c1ad3ca3-c412-46d4-84e9-c07ad4502685', '50e24231-a2e7-4caa-938f-41aeb03a7453', '5af6e41d-261f-4763-95ec-7a13a4b80d85'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0f205cfe-68d3-4151-9a9b-30358cb58e65 tempest-GroupSnapshotsTest-1838131471 None] group_snapshot dc857a37-1f38-454d-b963-7777161b4630: deleted successfully Nov 06 21:23:24 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.335s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Deleted volume successfully. Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-460672a7-31ca-41e5-8802-d65d1211a18a tempest-SnapshotsActionsTest-782655718 None] Lock "cinder-d2ddb660-dea3-478e-9033-251d61f9d293-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:24 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 1073741824" returned: 0 in 0.625s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:24 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 Nov 06 21:23:24 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc46a0f-a4cd-4a2b-8d17-3c78d5e6352f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:24 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 Nov 06 21:23:24 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284" returned: 0 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a5db11-1d05-470f-aca4-4f0b3d040b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fa29dc-841d-4a33-9123-ef0e04193284', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aada02d-06d5-4ab9-9d8b-4f349ca240bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Volume volume-95fa29dc-841d-4a33-9123-ef0e04193284 (95fa29dc-841d-4a33-9123-ef0e04193284): created successfully Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aada02d-06d5-4ab9-9d8b-4f349ca240bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (f3d0a4a4-5f2c-40da-8cdb-ecefe8771fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3735945c-4dd0-446a-9e4c-d7002d861368 tempest-VolumesListTestJSON-1372149302 None] Created volume successfully. Nov 06 21:23:25 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0" returned: 0 in 0.414s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:25 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0 Nov 06 21:23:25 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:25 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-de0ab55b-a760-40bd-91a2-284299377cd0" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Lock "cinder-quobyte-de0ab55b-a760-40bd-91a2-284299377cd0" released by "delete_volume" :: held 0.834s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['551646f4-39c9-4140-adb0-8af43883afb8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:25 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1994749434 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1994749434, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Created reservations ['0e797355-8155-4ae7-849f-8ea1cfb25e51', '96362054-daea-4c1c-a939-359636a4a197', 'a12521ac-b295-481a-b317-5aa38064e006', '1a5c32e8-75c9-4926-9b64-4108e16af215'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:25 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:25 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:26 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.544s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b98171d-53a0-4dca-8e70-d98f0bc3481c tempest-GroupSnapshotsTest-1838131471 None] Delete group completed successfully. Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (e54d99bd-f526-486a-a7f1-5c831b07a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e479241-1e8f-409f-bc71-2aab423bd6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e479241-1e8f-409f-bc71-2aab423bd6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1359886711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee9ade3-be79-4e83-8b3d-814e4eeeef5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:27Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0277411-af76-4fdc-ad5f-9c26d34e59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0277411-af76-4fdc-ad5f-9c26d34e59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccad9af-789a-49df-8222-e8f680bcb9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccad9af-789a-49df-8222-e8f680bcb9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee9ade3-be79-4e83-8b3d-814e4eeeef5a', 'volume_name': 'volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f00a24b-7bd6-4ceb-9c75-c64be1769811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f00a24b-7bd6-4ceb-9c75-c64be1769811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e8d2a0-a51d-4afd-857c-df759a161887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Volume 7ee9ade3-be79-4e83-8b3d-814e4eeeef5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a', 'volume_size': 1} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1359886711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee9ade3-be79-4e83-8b3d-814e4eeeef5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:27Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Creating volume 7ee9ade3-be79-4e83-8b3d-814e4eeeef5a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:27 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a 1073741824 Nov 06 21:23:27 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:27 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a 1073741824" returned: 0 in 0.591s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:27 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a Nov 06 21:23:27 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:27 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e8d2a0-a51d-4afd-857c-df759a161887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5be79a-1d21-465f-88d2-3ccb095118f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Volume volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a (7ee9ade3-be79-4e83-8b3d-814e4eeeef5a): created successfully Nov 06 21:23:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5be79a-1d21-465f-88d2-3ccb095118f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (e54d99bd-f526-486a-a7f1-5c831b07a65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3515df78-702e-4bb9-98aa-792678b1ad3b tempest-VolumesListTestJSON-1372149302 None] Created volume successfully. Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (5fdeabe4-1f98-45dc-b0af-10b2bd54dff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e31d1c-5fd4-4c00-a4cf-7967a68571da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e31d1c-5fd4-4c00-a4cf-7967a68571da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-192703243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502c2915-8aea-464f-8d7c-d175dafcfc8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:30Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e28022-d9a1-4803-9f7d-9f2fc495eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e28022-d9a1-4803-9f7d-9f2fc495eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26904b04-4cc2-4fc1-96f5-a102b883f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26904b04-4cc2-4fc1-96f5-a102b883f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502c2915-8aea-464f-8d7c-d175dafcfc8e', 'volume_name': 'volume-502c2915-8aea-464f-8d7c-d175dafcfc8e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc0c98-9579-4248-b5d4-17913409841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc0c98-9579-4248-b5d4-17913409841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821febde-cec8-4e25-a090-96ea1ffc5639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Volume 502c2915-8aea-464f-8d7c-d175dafcfc8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502c2915-8aea-464f-8d7c-d175dafcfc8e', 'volume_size': 1} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-192703243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502c2915-8aea-464f-8d7c-d175dafcfc8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ef46b832ae043a8b0231cb1304dcf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:30Z,use_quota=True,user_id='8cbed305fc6449dfad54ab854f6c1398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Creating volume 502c2915-8aea-464f-8d7c-d175dafcfc8e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:29 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e 1073741824 Nov 06 21:23:29 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:30 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e 1073741824" returned: 0 in 0.656s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:30 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e Nov 06 21:23:30 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:30 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e" returned: 0 in 0.311s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821febde-cec8-4e25-a090-96ea1ffc5639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502c2915-8aea-464f-8d7c-d175dafcfc8e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0495cf-51cc-4e30-8c3c-d3c84eabf2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Volume volume-502c2915-8aea-464f-8d7c-d175dafcfc8e (502c2915-8aea-464f-8d7c-d175dafcfc8e): created successfully Nov 06 21:23:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0495cf-51cc-4e30-8c3c-d3c84eabf2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Flow 'volume_create_manager' (5fdeabe4-1f98-45dc-b0af-10b2bd54dff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1a3fdc89-0efd-4df2-a41c-b352f333f926 tempest-VolumesListTestJSON-1372149302 None] Created volume successfully. Nov 06 21:23:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-502c2915-8aea-464f-8d7c-d175dafcfc8e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-502c2915-8aea-464f-8d7c-d175dafcfc8e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-quobyte-502c2915-8aea-464f-8d7c-d175dafcfc8e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-502c2915-8aea-464f-8d7c-d175dafcfc8e" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9fe7fd-8b54-44be-b321-840a76489708]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Flow 'volume_create_manager' (e7759357-1a32-447a-bef7-59e9ab219a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd759b70-2c05-44d8-803f-163b9787a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd759b70-2c05-44d8-803f-163b9787a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-527996744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8313b401-70b7-42a0-83ee-82dc1d10348f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5859e148ba451296dc8cdbe0868380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='2d210561e3a445ceb87dc1da5550fe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e Nov 06 21:23:35 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e3d1a5-1e2a-4a9c-9f77-3efb15b5eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e3d1a5-1e2a-4a9c-9f77-3efb15b5eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b750ee03-ed90-4e7a-822c-28eb322f292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b750ee03-ed90-4e7a-822c-28eb322f292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8313b401-70b7-42a0-83ee-82dc1d10348f', 'volume_name': 'volume-8313b401-70b7-42a0-83ee-82dc1d10348f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58d1e13-1879-4bb0-9ef3-d4bbed7be803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58d1e13-1879-4bb0-9ef3-d4bbed7be803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2933a81e-e3b4-4047-a87c-6291fcbf5415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume 8313b401-70b7-42a0-83ee-82dc1d10348f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8313b401-70b7-42a0-83ee-82dc1d10348f', 'volume_size': 1} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-527996744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8313b401-70b7-42a0-83ee-82dc1d10348f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5859e148ba451296dc8cdbe0868380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='2d210561e3a445ceb87dc1da5550fe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Creating volume 8313b401-70b7-42a0-83ee-82dc1d10348f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:35 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f 1073741824 Nov 06 21:23:35 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:35 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e" returned: 0 in 0.557s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e Nov 06 21:23:35 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f 1073741824" returned: 0 in 0.654s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-502c2915-8aea-464f-8d7c-d175dafcfc8e" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-502c2915-8aea-464f-8d7c-d175dafcfc8e" released by "delete_volume" :: held 1.010s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:36 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f Nov 06 21:23:36 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Created reservations ['19682683-ff2d-49b3-805f-9f9ffe434be7', 'c5c1e69a-9224-493c-9ff7-79f825c4e6b8', 'a4cbfda9-c7bf-45b9-a489-128a47a93631', '3c7a0600-2cb2-415f-984b-fb3e472df107'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:36 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:36 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f" returned: 0 in 0.423s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2933a81e-e3b4-4047-a87c-6291fcbf5415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8313b401-70b7-42a0-83ee-82dc1d10348f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb44223-5643-416f-bac1-83de3c92b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume volume-8313b401-70b7-42a0-83ee-82dc1d10348f (8313b401-70b7-42a0-83ee-82dc1d10348f): created successfully Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb44223-5643-416f-bac1-83de3c92b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Flow 'volume_create_manager' (e7759357-1a32-447a-bef7-59e9ab219a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d50c0d93-8bd1-4223-b4e8-7baf74fa796a tempest-VolumeQuotasAdminTestJSON-1178784901 None] Created volume successfully. Nov 06 21:23:36 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.483s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Deleted volume successfully. Nov 06 21:23:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-907aec41-aa6b-495e-8765-0c41336abc40 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-502c2915-8aea-464f-8d7c-d175dafcfc8e-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "cinder-8313b401-70b7-42a0-83ee-82dc1d10348f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "cinder-8313b401-70b7-42a0-83ee-82dc1d10348f-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-quobyte-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "cinder-quobyte-8313b401-70b7-42a0-83ee-82dc1d10348f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9292ffbb-2f26-4830-b84f-40818c009e60]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "cinder-quobyte-8313b401-70b7-42a0-83ee-82dc1d10348f" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0310dcb-ba19-49dc-87c6-7e2b5ded388d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:37 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a Nov 06 21:23:37 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f Nov 06 21:23:38 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:38 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f" returned: 0 in 0.492s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f Nov 06 21:23:38 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" returned: 0 in 0.609s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a Nov 06 21:23:38 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.353s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 28 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:23:38 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a" released by "delete_volume" :: held 0.986s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:38 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-8313b401-70b7-42a0-83ee-82dc1d10348f" returned: 0 in 0.429s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "cinder-quobyte-8313b401-70b7-42a0-83ee-82dc1d10348f" released by "delete_volume" :: held 1.004s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Created reservations ['a5a56f50-f873-4738-8f09-9df1a24138f3', '18711382-cb26-4371-b4d9-45bf82b2089d', 'eca98b8b-2213-4373-8eb3-68f6e5a51232', 'c9dc40d2-6c44-4a61-bbf6-879e6acc4df7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Created reservations ['3bd10896-54a6-438f-89a3-15f5ccbe9172', 'a9c4fe22-ecf1-49ff-ad10-5305d43ab37a', 'f95602a7-568a-4724-9e44-bad465f46fa0', '72bb62a5-5e1c-4001-86d9-3c86f20c2e49'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:39 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:39 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:39 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:39 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:39 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.503s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:39 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Deleted volume successfully. Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4362beb9-f9dd-4fff-bbeb-b304b89afe26 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-7ee9ade3-be79-4e83-8b3d-814e4eeeef5a-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Deleted volume successfully. Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-264ef9e2-8fb7-4940-9cba-e742b7a1b42d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "cinder-8313b401-70b7-42a0-83ee-82dc1d10348f-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Flow 'volume_create_manager' (a6fd1984-4e18-421f-a39c-16e5b8e1b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0033bef-78b3-4a9e-ba5e-762fc84a34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-95fa29dc-841d-4a33-9123-ef0e04193284-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0033bef-78b3-4a9e-ba5e-762fc84a34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702914122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad77941a-6aad-4ddf-b6ac-164a334e57fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5859e148ba451296dc8cdbe0868380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:40Z,use_quota=True,user_id='2d210561e3a445ceb87dc1da5550fe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b5856c-ec56-4c0f-b3a7-1f5f127a1189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b5856c-ec56-4c0f-b3a7-1f5f127a1189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464bb883-68b5-4c0d-a3c3-c4f78ae1db46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464bb883-68b5-4c0d-a3c3-c4f78ae1db46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad77941a-6aad-4ddf-b6ac-164a334e57fd', 'volume_name': 'volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53365ae6-456d-48ee-bae7-0a1901b1884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53365ae6-456d-48ee-bae7-0a1901b1884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf0ece-44e9-48af-9b19-ae2521763fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume ad77941a-6aad-4ddf-b6ac-164a334e57fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd', 'volume_size': 1} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702914122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad77941a-6aad-4ddf-b6ac-164a334e57fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5859e148ba451296dc8cdbe0868380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:40Z,use_quota=True,user_id='2d210561e3a445ceb87dc1da5550fe3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Creating volume ad77941a-6aad-4ddf-b6ac-164a334e57fd {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-95fa29dc-841d-4a33-9123-ef0e04193284-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd 1073741824 Nov 06 21:23:40 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "cinder-quobyte-95fa29dc-841d-4a33-9123-ef0e04193284" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-95fa29dc-841d-4a33-9123-ef0e04193284" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f7ab3-bb33-4eab-bad5-a6551fa8bcb3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 Nov 06 21:23:40 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:40 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284" returned: 0 in 0.511s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd 1073741824" returned: 0 in 0.654s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:40 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284 Nov 06 21:23:40 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd Nov 06 21:23:40 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-95fa29dc-841d-4a33-9123-ef0e04193284" returned: 0 in 0.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-quobyte-95fa29dc-841d-4a33-9123-ef0e04193284" released by "delete_volume" :: held 1.019s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:41 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd" returned: 0 in 0.393s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf0ece-44e9-48af-9b19-ae2521763fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4d78d4-55fe-4c2e-822b-5c09d838f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Volume volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd (ad77941a-6aad-4ddf-b6ac-164a334e57fd): created successfully Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4d78d4-55fe-4c2e-822b-5c09d838f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Flow 'volume_create_manager' (a6fd1984-4e18-421f-a39c-16e5b8e1b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-eda0075c-86e1-44f4-a20d-456056e6d26d tempest-VolumeQuotasAdminTestJSON-1178784901 None] Created volume successfully. Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Created reservations ['7a01fdb1-0ba1-4797-aeda-818e4978735d', '45476b17-2ea2-48a5-99d5-c1a2b22e08d0', 'd7b09088-c317-4c6f-b9a6-dbb224a2355e', 'a7f31f37-61cf-41f2-a4e3-083c9b358a88'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:41 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.332s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Deleted volume successfully. Nov 06 21:23:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-86967b4f-2692-4ca3-b023-002d91f9c991 tempest-VolumesListTestJSON-1372149302 None] Lock "cinder-95fa29dc-841d-4a33-9123-ef0e04193284-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-310fe503-1d5a-450b-ada3-8c132dc188b6 tempest-VolumeQuotasAdminTestJSON-987850892 None] Transfer volume completed successfully. Nov 06 21:23:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Acquiring lock "cinder-ad77941a-6aad-4ddf-b6ac-164a334e57fd-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "cinder-ad77941a-6aad-4ddf-b6ac-164a334e57fd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Acquiring lock "cinder-quobyte-ad77941a-6aad-4ddf-b6ac-164a334e57fd" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "cinder-quobyte-ad77941a-6aad-4ddf-b6ac-164a334e57fd" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[702afd38-f308-4020-a644-bef86a64c16e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:44 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd Nov 06 21:23:44 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd" returned: 0 in 0.492s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:44 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd Nov 06 21:23:44 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ad77941a-6aad-4ddf-b6ac-164a334e57fd" returned: 0 in 0.345s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "cinder-quobyte-ad77941a-6aad-4ddf-b6ac-164a334e57fd" released by "delete_volume" :: held 0.910s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Created reservations ['fb4c4436-3193-4fa9-9516-2f6883eae82d', '6c8b180e-3be3-450c-9357-d5e182884e21', '3921452c-ccd4-4650-bb77-ed7556f7a1f9', '6c05e0c6-cf08-49c4-9988-70f9ca47aef5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:45 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:23:45 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:45 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Deleted volume successfully. Nov 06 21:23:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a79113a7-ab6b-43ef-84c3-5d4be2c52790 tempest-VolumeQuotasAdminTestJSON-981688875 None] Lock "cinder-ad77941a-6aad-4ddf-b6ac-164a334e57fd-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Flow 'volume_create_manager' (e8196fcc-8477-447e-bae3-8d1a322d3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b9a122-a690-4fa1-b5a4-24ade5f66776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b9a122-a690-4fa1-b5a4-24ade5f66776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1432902813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d47b1-4b76-4f35-8ff3-7bcc460d706b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e3dd1601364fce80a61939bca0d23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:48Z,use_quota=True,user_id='faf25a482d2d478e8052877d9946d489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af88d3a1-7222-4978-a133-0bf6b3f9a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af88d3a1-7222-4978-a133-0bf6b3f9a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e39f0b-aeb6-4f06-814a-0616f179bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e39f0b-aeb6-4f06-814a-0616f179bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966d47b1-4b76-4f35-8ff3-7bcc460d706b', 'volume_name': 'volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664574b3-1ec1-4436-b8bd-bcf030edebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664574b3-1ec1-4436-b8bd-bcf030edebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12a14b-7b1a-4e56-a950-d13a359b43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b', 'volume_size': 1} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1432902813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966d47b1-4b76-4f35-8ff3-7bcc460d706b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e3dd1601364fce80a61939bca0d23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:48Z,use_quota=True,user_id='faf25a482d2d478e8052877d9946d489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Creating volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:48 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:23:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:48 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b 1073741824 Nov 06 21:23:48 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:49 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b 1073741824" returned: 0 in 0.597s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:49 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b Nov 06 21:23:49 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:49 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b" returned: 0 in 0.318s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12a14b-7b1a-4e56-a950-d13a359b43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a67fdec-9ecf-450b-8afd-d152e886c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Volume volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b (966d47b1-4b76-4f35-8ff3-7bcc460d706b): created successfully Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a67fdec-9ecf-450b-8afd-d152e886c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Flow 'volume_create_manager' (e8196fcc-8477-447e-bae3-8d1a322d3791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1aae7a94-5545-4822-9ebc-ba3c28dca3bf tempest-VolumesSnapshotListTestJSON-2006112455 None] Created volume successfully. Nov 06 21:23:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Creating offline snapshot b8a60410-0e04-4424-a853-95fea9ccbbcd of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1b338d-aab0-454f-bd57-b1e33e4b0666]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b Nov 06 21:23:51 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:51 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b" returned: 0 in 0.561s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:51 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd 1G Nov 06 21:23:51 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:52 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd 1G" returned: 0 in 0.629s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:52 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:23:52 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:52 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd is being set with open permissions: ugo+rw Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:52 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:23:52 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:52 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.291s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:52 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info Nov 06 21:23:52 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:53 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info" returned: 0 in 0.331s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:53 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info is being set with open permissions: ugo+rw Nov 06 21:23:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:53 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info Nov 06 21:23:53 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:53 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.info" returned: 0 in 0.316s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f615d026-aa1b-41d7-bb76-4af7c7c0542a tempest-VolumesSnapshotListTestJSON-2006112455 None] Create snapshot completed successfully Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Creating offline snapshot ddb5e927-5c65-4f5e-98fb-f589f164b2ee of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7b7a2-ac5b-48fb-a6af-cb5f0997f6d0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:54 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:23:54 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:54 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:55 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee 1G Nov 06 21:23:55 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:55 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee 1G" returned: 0 in 0.663s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:55 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:23:55 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:55 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:56 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee is being set with open permissions: ugo+rw Nov 06 21:23:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:56 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:23:56 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:56 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-61f5bf63-ef5c-49bb-bffb-e881c30a25a9 tempest-VolumesSnapshotListTestJSON-2006112455 None] Create snapshot completed successfully Nov 06 21:23:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Creating offline snapshot 7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bf4857-fd54-48d9-b76e-d5411f08d5a9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:58 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:23:58 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:58 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:58 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 1G Nov 06 21:23:58 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:59 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 1G" returned: 0 in 0.887s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:59 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 Nov 06 21:23:59 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:59 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:59 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 is being set with open permissions: ugo+rw Nov 06 21:23:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:59 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 Nov 06 21:23:59 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:59 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" returned: 0 in 0.317s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3129ba95-5d2f-4c50-9fc8-80b541bde29f tempest-VolumesSnapshotListTestJSON-2006112455 None] Create snapshot completed successfully Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (9759ee46-bc8e-486b-8aa2-c285d4a6730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac95f9af-f106-4658-842b-6dd06118dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac95f9af-f106-4658-842b-6dd06118dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1978426846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848d1981-5c59-4585-8cd0-45076343e167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:00Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1387f765-4bb0-42bc-b645-daf94c6fd577),volume_type_id=1387f765-4bb0-42bc-b645-daf94c6fd577)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55681cd2-50f4-419d-ac70-7303dec2ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55681cd2-50f4-419d-ac70-7303dec2ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bc494e-1c28-4732-82ec-7d2f72c3d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bc494e-1c28-4732-82ec-7d2f72c3d037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848d1981-5c59-4585-8cd0-45076343e167', 'volume_name': 'volume-848d1981-5c59-4585-8cd0-45076343e167', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b04388-e580-4fc8-808d-f35c4643fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b04388-e580-4fc8-808d-f35c4643fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea5e5b7-e07b-4146-a084-d3a151d965f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume 848d1981-5c59-4585-8cd0-45076343e167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848d1981-5c59-4585-8cd0-45076343e167', 'volume_size': 1} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1978426846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848d1981-5c59-4585-8cd0-45076343e167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:00Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1387f765-4bb0-42bc-b645-daf94c6fd577),volume_type_id=1387f765-4bb0-42bc-b645-daf94c6fd577)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Creating volume 848d1981-5c59-4585-8cd0-45076343e167 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:00 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:00 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 1073741824 Nov 06 21:24:00 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:01 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (a48a6bb7-6cfd-42a5-8503-0d71065afa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a958c2aa-f182-49a5-8843-9dcb0f0670b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 1073741824" returned: 0 in 0.853s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a958c2aa-f182-49a5-8843-9dcb0f0670b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2008228875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300db7dc-5ed6-4079-a40b-b8c14e602125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:01Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a558e8cb-0c11-42bf-a897-c5682903446f),volume_type_id=a558e8cb-0c11-42bf-a897-c5682903446f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a4aa94-93a9-44d9-95f6-5d6d189e810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a4aa94-93a9-44d9-95f6-5d6d189e810d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8d141-4640-4d62-b4b6-54afc4d07a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8d141-4640-4d62-b4b6-54afc4d07a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300db7dc-5ed6-4079-a40b-b8c14e602125', 'volume_name': 'volume-300db7dc-5ed6-4079-a40b-b8c14e602125', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d0062f-b3fe-41aa-ae5d-d2440cd6741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d0062f-b3fe-41aa-ae5d-d2440cd6741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f84a8f-c6a3-4d08-8215-16b18ef44298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume 300db7dc-5ed6-4079-a40b-b8c14e602125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300db7dc-5ed6-4079-a40b-b8c14e602125', 'volume_size': 1} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:01 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 Nov 06 21:24:01 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:01 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.564s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2008228875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300db7dc-5ed6-4079-a40b-b8c14e602125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:01Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a558e8cb-0c11-42bf-a897-c5682903446f),volume_type_id=a558e8cb-0c11-42bf-a897-c5682903446f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Creating volume 300db7dc-5ed6-4079-a40b-b8c14e602125 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:01 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 1073741824 Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea5e5b7-e07b-4146-a084-d3a151d965f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848d1981-5c59-4585-8cd0-45076343e167', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28566d6-5b48-4488-b91c-5807d9956ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume volume-848d1981-5c59-4585-8cd0-45076343e167 (848d1981-5c59-4585-8cd0-45076343e167): created successfully Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28566d6-5b48-4488-b91c-5807d9956ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (9759ee46-bc8e-486b-8aa2-c285d4a6730c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8a65c567-4ce2-4caa-8cfe-26c48e1f82e9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Created volume successfully. Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (d3f4522f-6bc8-4168-8b24-25a767c6aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001c1476-9542-4dee-8493-147b5900f2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001c1476-9542-4dee-8493-147b5900f2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-511505535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b948c00d-bd6a-495d-9d66-0927d7c999ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:02Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dbccb2d-a49f-4c45-90f5-fc23d144c088),volume_type_id=0dbccb2d-a49f-4c45-90f5-fc23d144c088)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27045f49-5ea8-44c7-9a29-3ba7d1ee3aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27045f49-5ea8-44c7-9a29-3ba7d1ee3aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ad9a3d-3600-4949-9ba2-87fee56fe323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:24:02 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 1073741824" returned: 0 in 0.843s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:02 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 Nov 06 21:24:02 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:03 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125" returned: 0 in 0.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f84a8f-c6a3-4d08-8215-16b18ef44298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300db7dc-5ed6-4079-a40b-b8c14e602125', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370c2c8-fd55-4dda-bb30-306901fdf574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume volume-300db7dc-5ed6-4079-a40b-b8c14e602125 (300db7dc-5ed6-4079-a40b-b8c14e602125): created successfully Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6370c2c8-fd55-4dda-bb30-306901fdf574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (a48a6bb7-6cfd-42a5-8503-0d71065afa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-67e14493-cfd5-4503-a52a-a93d7ff39c5d tempest-TestInstancesWithCinderVolumes-1404121332 None] Created volume successfully. Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Deleting offline snapshot 7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] snapshot_file for this snap is: volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[03685efa-068b-431b-8b06-7e127fcd3d6e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ad9a3d-3600-4949-9ba2-87fee56fe323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b948c00d-bd6a-495d-9d66-0927d7c999ce', 'volume_name': 'volume-b948c00d-bd6a-495d-9d66-0927d7c999ce', 'volume_size': 1, 'image_id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--502447379', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66635aef04f94ae2ad72c6945fd185c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a480c8e-5243-4029-bf65-794a76aa9d92/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1e5f0-64ed-48c5-b73b-283ecacbe953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1e5f0-64ed-48c5-b73b-283ecacbe953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6173c720-96e5-4510-83e4-61481b71cb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume b948c00d-bd6a-495d-9d66-0927d7c999ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b948c00d-bd6a-495d-9d66-0927d7c999ce', 'volume_size': 1, 'image_id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--502447379', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66635aef04f94ae2ad72c6945fd185c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a480c8e-5243-4029-bf65-794a76aa9d92/file', 'properties': {}}, 'image_service': } Nov 06 21:24:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Trying to clone b948c00d-bd6a-495d-9d66-0927d7c999ce from image 8a480c8e-5243-4029-bf65-794a76aa9d92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:24:03 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 Nov 06 21:24:03 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:04 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[29520969-1f09-4b49-9f29-da0189acf3ba]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:04 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:24:04 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:04 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.545s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:04 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 Nov 06 21:24:04 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:05 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" returned: 0 in 0.545s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:05 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5 Nov 06 21:24:05 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:05 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" returned: 0 in 0.366s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5" released by "_delete_snapshot" :: held 2.088s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" released by "delete_snapshot" :: held 2.119s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Created reservations ['c6794eed-c03d-4cab-a288-9ef8541b8df4', '90c56f33-f873-4fa2-a10b-46681811759e', 'c51168b3-439f-498f-b9f4-bd60282cbd97', '434c9db2-d166-4853-a804-e9ec1ff0fc5b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Delete snapshot completed successfully. Nov 06 21:24:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dfcacb-b242-4241-abb4-aa8b0a7f5e3b tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-7ab60dbe-5dab-4601-8771-ac3cf1d6a1f5-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-ddb5e927-5c65-4f5e-98fb-f589f164b2ee-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-ddb5e927-5c65-4f5e-98fb-f589f164b2ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-ddb5e927-5c65-4f5e-98fb-f589f164b2ee" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-ddb5e927-5c65-4f5e-98fb-f589f164b2ee" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Deleting offline snapshot ddb5e927-5c65-4f5e-98fb-f589f164b2ee of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] snapshot_file for this snap is: volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[67698adb-e279-4498-a41d-e74c5516b37c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:06 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:24:06 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:07 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.493s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c78b17-579c-4596-8a44-57d6937ac5a1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:07 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:24:07 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:07 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.609s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:08 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:24:08 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD, size 20.69 MB, duration 4.78 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:24:08 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Image download 20.69 MB at 4.33 MB/s Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e1ec7-6bde-4d0c-82e4-167299c65335]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:08 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.601s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:08 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD Nov 06 21:24:08 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:08 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee Nov 06 21:24:08 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:08 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Temporary image 8a480c8e-5243-4029-bf65-794a76aa9d92 is fetched for user f53eb98ffc3646f2a447993bfc84ed89. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:24:08 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.ddb5e927-5c65-4f5e-98fb-f589f164b2ee" returned: 0 in 0.365s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-ddb5e927-5c65-4f5e-98fb-f589f164b2ee" released by "_delete_snapshot" :: held 2.271s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" released by "delete_snapshot" :: held 2.313s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a0534-348d-4b2b-a86e-ed8875dce012]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Created reservations ['a041ba5b-67d8-448a-8d5f-2b4a6aa08664', '611a258c-ee07-4e73-a66a-06f543e7e386', 'd4c306fe-097d-4be0-9ddb-69be7bad7ae1', '51dda5a4-dc56-4c03-9ed2-74c2f58334f6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:09 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD Nov 06 21:24:09 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Delete snapshot completed successfully. Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c44f8d02-ab77-4b4e-bcc5-2334498134f5 tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-ddb5e927-5c65-4f5e-98fb-f589f164b2ee-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:09 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-511505535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b948c00d-bd6a-495d-9d66-0927d7c999ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66635aef04f94ae2ad72c6945fd185c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:02Z,use_quota=True,user_id='f53eb98ffc3646f2a447993bfc84ed89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dbccb2d-a49f-4c45-90f5-fc23d144c088),volume_type_id=0dbccb2d-a49f-4c45-90f5-fc23d144c088)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Creating volume b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:09 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:09 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1073741824 Nov 06 21:24:09 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-b8a60410-0e04-4424-a853-95fea9ccbbcd-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-b8a60410-0e04-4424-a853-95fea9ccbbcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-b8a60410-0e04-4424-a853-95fea9ccbbcd" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-b8a60410-0e04-4424-a853-95fea9ccbbcd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Deleting offline snapshot b8a60410-0e04-4424-a853-95fea9ccbbcd of volume 966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] snapshot_file for this snap is: volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05e730-7254-43cc-afda-928f1aea6050]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:10 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1073741824" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:10 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce Nov 06 21:24:10 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:10 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:24:10 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:10 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Attempting download of 8a480c8e-5243-4029-bf65-794a76aa9d92 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}])) to volume b948c00d-bd6a-495d-9d66-0927d7c999ce. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f147789-5358-42c6-bfc5-adfc272bdd1c]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:10 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.527s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbf4b1-e489-4fb2-92cf-33c526d29a20]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:10 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze Nov 06 21:24:10 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:10 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b Nov 06 21:24:10 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze" returned: 0 in 0.408s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:11 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b" returned: 0 in 0.518s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:11 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze Nov 06 21:24:11 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:24:11 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze" returned: 1 in 0.485s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a480c8e-5243-4029-bf65-794a76aa9d92_h9xti9ze' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[558869ea-7d0b-46f5-b77b-a0bcb9fb5289]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:11 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD Nov 06 21:24:11 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.487s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:11 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd Nov 06 21:24:11 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:11 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] 8a480c8e-5243-4029-bf65-794a76aa9d92 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:24:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:12 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b.b8a60410-0e04-4424-a853-95fea9ccbbcd" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:12 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce Nov 06 21:24:12 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-b8a60410-0e04-4424-a853-95fea9ccbbcd" released by "_delete_snapshot" :: held 2.036s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" released by "delete_snapshot" :: held 2.090s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Created reservations ['4253dbe4-75b0-465b-ba51-f1f0492483af', 'd9d75bf2-2dcc-4639-9348-6f0480f8b2c3', '53d2cb8a-50ad-43cd-a5a3-3ccb8987bb25', 'a16ea14c-f325-4a52-b47a-6d8d932c9a34'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Delete snapshot completed successfully. Nov 06 21:24:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-49953ddb-f391-4d17-9d4c-889c2a3fcb8d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-b8a60410-0e04-4424-a853-95fea9ccbbcd-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-966d47b1-4b76-4f35-8ff3-7bcc460d706b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-966d47b1-4b76-4f35-8ff3-7bcc460d706b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9a542-a20b-4bd8-942e-9aab2f0a5b30]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:13 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b Nov 06 21:24:13 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:14 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b" returned: 0 in 0.519s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:14 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b Nov 06 21:24:14 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:14 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-966d47b1-4b76-4f35-8ff3-7bcc460d706b" returned: 0 in 0.470s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-quobyte-966d47b1-4b76-4f35-8ff3-7bcc460d706b" released by "delete_volume" :: held 1.109s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Created reservations ['78049267-9472-4084-81ee-566dfc04eb62', '0ca3caad-c128-4203-8e59-6751d96ff05d', '2e2f364b-baf8-4573-85b1-f9ab3ffe1ed9', 'cbb643fa-3fb7-41d9-852e-dbb0607171eb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:14 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce" returned: 0 in 2.745s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a480c8e-5243-4029-bf65-794a76aa9d92_lr55ipn3devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:24:14 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Converted 112.00 MB image at 40.79 MB/s Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:14 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1G Nov 06 21:24:14 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:14 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:14 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:15 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Deleted volume successfully. Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5490b779-b17a-4eee-9b6b-9a652991e52d tempest-VolumesSnapshotListTestJSON-2006112455 None] Lock "cinder-966d47b1-4b76-4f35-8ff3-7bcc460d706b-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:15 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce 1G" returned: 0 in 0.540s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Downloaded image 8a480c8e-5243-4029-bf65-794a76aa9d92 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}])) to volume b948c00d-bd6a-495d-9d66-0927d7c999ce successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Temporary image 8a480c8e-5243-4029-bf65-794a76aa9d92 for user f53eb98ffc3646f2a447993bfc84ed89 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Marking volume b948c00d-bd6a-495d-9d66-0927d7c999ce as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Copying metadata from image 8a480c8e-5243-4029-bf65-794a76aa9d92 to b948c00d-bd6a-495d-9d66-0927d7c999ce. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Creating volume glance metadata for volume b948c00d-bd6a-495d-9d66-0927d7c999ce backed by image 8a480c8e-5243-4029-bf65-794a76aa9d92 with: {'image_id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'image_name': 'tempest-scenario-img--502447379', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6173c720-96e5-4510-83e4-61481b71cb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b948c00d-bd6a-495d-9d66-0927d7c999ce', 'volume_size': 1, 'image_id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a480c8e-5243-4029-bf65-794a76aa9d92', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--502447379', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66635aef04f94ae2ad72c6945fd185c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a480c8e-5243-4029-bf65-794a76aa9d92', 'created_at': datetime.datetime(2026, 11, 6, 20, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 23, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a480c8e-5243-4029-bf65-794a76aa9d92/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d074a-7b16-4151-9c1f-81bb4c7f22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Volume volume-b948c00d-bd6a-495d-9d66-0927d7c999ce (b948c00d-bd6a-495d-9d66-0927d7c999ce): created successfully Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d074a-7b16-4151-9c1f-81bb4c7f22a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Flow 'volume_create_manager' (d3f4522f-6bc8-4168-8b24-25a767c6aeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ea141e48-520a-4af5-b5c6-ba605829006b tempest-TestInstancesWithCinderVolumes-1404121332 None] Created volume successfully. Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=108,cinder:INSERT=39,cinder:UPDATE=124,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=105,cinder:INSERT=34,cinder:UPDATE=134,cinder:DELETE=13 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (da5afefd-058d-4b11-93e0-e6f03c1e1b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b43c57d-48ad-4162-b85e-b9fb06ad3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b43c57d-48ad-4162-b85e-b9fb06ad3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-903467509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed22776-abd8-4da2-9f05-fc9177a3bd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:22Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0c957c-7e8d-444e-91fd-0df5b6c0ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0c957c-7e8d-444e-91fd-0df5b6c0ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e4657d-fca8-4bd7-9ac4-8265c6ce3783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e4657d-fca8-4bd7-9ac4-8265c6ce3783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed22776-abd8-4da2-9f05-fc9177a3bd62', 'volume_name': 'volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1be611-98e9-4aff-ade0-bafcba2ae0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1be611-98e9-4aff-ade0-bafcba2ae0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c777981-6f31-47a2-a4f9-7f5c38d6b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Volume 2ed22776-abd8-4da2-9f05-fc9177a3bd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62', 'volume_size': 1} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-903467509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed22776-abd8-4da2-9f05-fc9177a3bd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:22Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Creating volume 2ed22776-abd8-4da2-9f05-fc9177a3bd62 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:22 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:22 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 1073741824 Nov 06 21:24:22 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:23 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 1073741824" returned: 0 in 0.717s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:23 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 Nov 06 21:24:23 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a9b9d082-dc86-4b58-a622-22451d713732 req-e5d04332-8952-4e30-b557-a3e0f3a771b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:23 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62" returned: 0 in 0.496s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a9b9d082-dc86-4b58-a622-22451d713732 req-e5d04332-8952-4e30-b557-a3e0f3a771b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.142s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a9b9d082-dc86-4b58-a622-22451d713732 req-e5d04332-8952-4e30-b557-a3e0f3a771b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c777981-6f31-47a2-a4f9-7f5c38d6b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b1fa1-ef2d-470c-ae8e-5c5798056abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Volume volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 (2ed22776-abd8-4da2-9f05-fc9177a3bd62): created successfully Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b1fa1-ef2d-470c-ae8e-5c5798056abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (da5afefd-058d-4b11-93e0-e6f03c1e1b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4bdb8072-2f1c-4660-9e2b-abafd781a141 tempest-VolumesListAdminTestJSON-84271335 None] Created volume successfully. Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Flow 'volume_create_manager' (cb3c26e1-3002-4c1f-8381-ee0643a5a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15370b-0e0f-4e3c-ab9b-f62eeec8efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-a9b9d082-dc86-4b58-a622-22451d713732 req-e5d04332-8952-4e30-b557-a3e0f3a771b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-b948c00d-bd6a-495d-9d66-0927d7c999ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e6ddaa9-2eb4-42e7-95c5-bb7faba8f434', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15370b-0e0f-4e3c-ab9b-f62eeec8efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1461199918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d96976-45aa-4d45-85cc-033462367985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8664d4cd574023b9d68ea9c41d5f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:24Z,use_quota=True,user_id='497d972f834c4533a5e7c799dca55cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2948c81-f017-4129-976d-2f6835974555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2948c81-f017-4129-976d-2f6835974555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1b2ad5-23ab-440a-8404-a0507e25d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1b2ad5-23ab-440a-8404-a0507e25d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d96976-45aa-4d45-85cc-033462367985', 'volume_name': 'volume-52d96976-45aa-4d45-85cc-033462367985', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4769ffd-5d03-4371-833c-8eb4d617086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4769ffd-5d03-4371-833c-8eb4d617086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa2a392-4b5d-495e-b6f5-919e4fba409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Volume 52d96976-45aa-4d45-85cc-033462367985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d96976-45aa-4d45-85cc-033462367985', 'volume_size': 2} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1461199918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d96976-45aa-4d45-85cc-033462367985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8664d4cd574023b9d68ea9c41d5f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:24Z,use_quota=True,user_id='497d972f834c4533a5e7c799dca55cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Creating volume 52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 2147483648 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:24 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 2147483648 Nov 06 21:24:24 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-a9b9d082-dc86-4b58-a622-22451d713732 req-e5d04332-8952-4e30-b557-a3e0f3a771b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] attachment_update completed successfully. Nov 06 21:24:25 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 2147483648" returned: 0 in 0.953s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:25 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 Nov 06 21:24:25 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:25 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa2a392-4b5d-495e-b6f5-919e4fba409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d96976-45aa-4d45-85cc-033462367985', 'volume_size': 2}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66981cf2-c4a2-41ba-b562-1aba9b5dd197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Volume volume-52d96976-45aa-4d45-85cc-033462367985 (52d96976-45aa-4d45-85cc-033462367985): created successfully Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66981cf2-c4a2-41ba-b562-1aba9b5dd197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Flow 'volume_create_manager' (cb3c26e1-3002-4c1f-8381-ee0643a5a562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2233de3b-802c-4cb1-8242-f1cfc28ef5ed tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Created volume successfully. Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (dccda150-9b7b-4bd2-8947-e5ba3e75118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5657b043-d6b0-450e-bf18-611d16f2dc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5657b043-d6b0-450e-bf18-611d16f2dc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783753495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43d879a-ff3d-4fe9-aab9-18b1d30f78af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:26Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e349b189-4900-4d0f-b728-38f8a558b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e349b189-4900-4d0f-b728-38f8a558b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e18e52-6a9c-4481-85ff-65dcd112ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e18e52-6a9c-4481-85ff-65dcd112ec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43d879a-ff3d-4fe9-aab9-18b1d30f78af', 'volume_name': 'volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a329b3b4-4330-4405-b6ef-09785b4d4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a329b3b4-4330-4405-b6ef-09785b4d4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4558ad61-0f78-44d9-b94b-b5adb4503080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Volume b43d879a-ff3d-4fe9-aab9-18b1d30f78af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af', 'volume_size': 1} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783753495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43d879a-ff3d-4fe9-aab9-18b1d30f78af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:26Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Creating volume b43d879a-ff3d-4fe9-aab9-18b1d30f78af {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:26 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af 1073741824 Nov 06 21:24:26 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:26 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af 1073741824" returned: 0 in 0.805s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:26 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af Nov 06 21:24:26 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:27 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.523s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4558ad61-0f78-44d9-b94b-b5adb4503080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddb5ef0-9f45-4080-b5d8-4cd9e0824998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Creating offline snapshot 1b479082-c603-40ca-8d7f-da842e0371a9 of volume 52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:24:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Volume volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af (b43d879a-ff3d-4fe9-aab9-18b1d30f78af): created successfully Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddb5ef0-9f45-4080-b5d8-4cd9e0824998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (dccda150-9b7b-4bd2-8947-e5ba3e75118d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d9b15-5e3f-4785-8d13-422bb389bba2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b2d15973-1a60-42bd-a0b0-ad4cb0aae738 tempest-VolumesListAdminTestJSON-84271335 None] Created volume successfully. Nov 06 21:24:27 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 Nov 06 21:24:27 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:27 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985" returned: 0 in 0.507s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:27 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 2G Nov 06 21:24:27 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:28 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 2G" returned: 0 in 0.767s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d96976-45aa-4d45-85cc-033462367985 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:28 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d96976-45aa-4d45-85cc-033462367985 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 Nov 06 21:24:28 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (57361c91-8e2d-40e2-bef4-68a1c9bb4639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72b5edf-4b6e-402c-82f3-129a0903628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72b5edf-4b6e-402c-82f3-129a0903628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-166864071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c179292-7e91-40b3-ad9b-7d752c12b5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:29Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84474d8b-5ba4-4e9f-a036-2aa297004c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84474d8b-5ba4-4e9f-a036-2aa297004c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfcf9b2-e57c-4dab-8bf1-290264e05f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfcf9b2-e57c-4dab-8bf1-290264e05f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c179292-7e91-40b3-ad9b-7d752c12b5c7', 'volume_name': 'volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5939e3d2-d0bc-4a3d-978b-d6bed4007315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5939e3d2-d0bc-4a3d-978b-d6bed4007315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f09adf-c08b-4871-ae78-8286656f708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Volume 9c179292-7e91-40b3-ad9b-7d752c12b5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7', 'volume_size': 1} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:29 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d96976-45aa-4d45-85cc-033462367985 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9" returned: 0 in 0.780s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:29 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 is being set with open permissions: ugo+rw Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:29 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 Nov 06 21:24:29 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:29 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9" returned: 0 in 0.553s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:29 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info Nov 06 21:24:29 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:30 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info" returned: 0 in 0.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:30 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info is being set with open permissions: ugo+rw Nov 06 21:24:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:30 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info Nov 06 21:24:30 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:30 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.info" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.972s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-166864071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c179292-7e91-40b3-ad9b-7d752c12b5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9994c02d9d54b0985496328c16280e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:29Z,use_quota=True,user_id='d49d38938e1947b092d66d88ef327a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Creating volume 9c179292-7e91-40b3-ad9b-7d752c12b5c7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:31 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 1073741824 Nov 06 21:24:31 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b99bb40d-938e-4744-8611-f3ccfca12842 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Create snapshot completed successfully Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "cinder-1b479082-c603-40ca-8d7f-da842e0371a9-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:32 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 1073741824" returned: 0 in 1.273s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-1b479082-c603-40ca-8d7f-da842e0371a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "cinder-quobyte-1b479082-c603-40ca-8d7f-da842e0371a9" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-1b479082-c603-40ca-8d7f-da842e0371a9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Deleting offline snapshot 1b479082-c603-40ca-8d7f-da842e0371a9 of volume 52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] snapshot_file for this snap is: volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f32168-f48e-4ba6-ad00-340b4e0402fe]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:32 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 Nov 06 21:24:32 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:32 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 Nov 06 21:24:32 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:33 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7" returned: 0 in 0.506s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f09adf-c08b-4871-ae78-8286656f708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438e2a4c-b86d-4929-bb27-b64711754488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Volume volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 (9c179292-7e91-40b3-ad9b-7d752c12b5c7): created successfully Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438e2a4c-b86d-4929-bb27-b64711754488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Flow 'volume_create_manager' (57361c91-8e2d-40e2-bef4-68a1c9bb4639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2388a50d-af14-4cd0-9072-c434ca30e232 tempest-VolumesListAdminTestJSON-84271335 None] Created volume successfully. Nov 06 21:24:33 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9" returned: 0 in 1.133s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52d96976-45aa-4d45-85cc-033462367985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a113b6-670a-4244-b3eb-b8a4d3e017f2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:34 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 Nov 06 21:24:34 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:34 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:34 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 Nov 06 21:24:34 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:35 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9" returned: 0 in 1.014s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:35 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9 Nov 06 21:24:35 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Flow 'volume_create_manager' (c54e5e38-400a-4dc0-ba0b-a998e6050e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b72a9f-be25-4836-9926-e261046fcb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b72a9f-be25-4836-9926-e261046fcb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7c16aa-44fc-498d-9732-678b438e7de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d3e1184d474696890a850645a7e3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:36Z,use_quota=True,user_id='592a300f42f9431b83aecfd13a327905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac2934-db0e-4334-b936-c52ff0863cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac2934-db0e-4334-b936-c52ff0863cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af53d25e-b9fa-46db-abc2-dea8fe8238c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af53d25e-b9fa-46db-abc2-dea8fe8238c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7c16aa-44fc-498d-9732-678b438e7de7', 'volume_name': 'volume-2f7c16aa-44fc-498d-9732-678b438e7de7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1f4d4f-b8e7-43fe-8217-1cc61944f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1f4d4f-b8e7-43fe-8217-1cc61944f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1485884-6a9b-4b3f-9f9c-39daa84741a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Volume 2f7c16aa-44fc-498d-9732-678b438e7de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7c16aa-44fc-498d-9732-678b438e7de7', 'volume_size': 1} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7c16aa-44fc-498d-9732-678b438e7de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d3e1184d474696890a850645a7e3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:36Z,use_quota=True,user_id='592a300f42f9431b83aecfd13a327905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Creating volume 2f7c16aa-44fc-498d-9732-678b438e7de7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:36 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 1073741824 Nov 06 21:24:36 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:36 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985.1b479082-c603-40ca-8d7f-da842e0371a9" returned: 0 in 0.809s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-1b479082-c603-40ca-8d7f-da842e0371a9" released by "_delete_snapshot" :: held 3.960s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" released by "delete_snapshot" :: held 4.032s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (b08e2b83-707d-4ed4-b8a6-d1080f59a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abdf18c-08b1-4faa-a1b3-ea1cc528a588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abdf18c-08b1-4faa-a1b3-ea1cc528a588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371808994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9553d4e-4d07-4f30-9750-56737e40d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:37Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e3b6d-e1f7-4cdc-8667-1a9ad21e81d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678e3b6d-e1f7-4cdc-8667-1a9ad21e81d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74af14b-4c4d-4497-9436-7d645d744970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74af14b-4c4d-4497-9436-7d645d744970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9553d4e-4d07-4f30-9750-56737e40d0d5', 'volume_name': 'volume-e9553d4e-4d07-4f30-9750-56737e40d0d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb070b8-5b5e-45fb-a5b9-3c65e0ef705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb070b8-5b5e-45fb-a5b9-3c65e0ef705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499dc5eb-541f-4977-a6d8-c89276a26bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Volume e9553d4e-4d07-4f30-9750-56737e40d0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9553d4e-4d07-4f30-9750-56737e40d0d5', 'volume_size': 1} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Created reservations ['7b3b81a9-0327-4103-be6d-8cb79fa0a04d', '06da7c3f-e28d-4c5c-a7d5-941c00f0008e', '87aca958-bfab-406e-b84b-f99171b800f4', 'a7255b04-cf66-4c85-9e3b-a8bd200b7050'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Delete snapshot completed successfully. Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6159ca02-1569-413e-a88d-372549b7899d tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-1b479082-c603-40ca-8d7f-da842e0371a9-delete_snapshot" released by "delete_snapshot" :: held 4.624s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:37 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 1073741824" returned: 0 in 1.149s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:37 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 Nov 06 21:24:37 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:37 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7" returned: 0 in 0.370s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371808994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9553d4e-4d07-4f30-9750-56737e40d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:37Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Creating volume e9553d4e-4d07-4f30-9750-56737e40d0d5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:37 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:37 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 1073741824 Nov 06 21:24:37 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1485884-6a9b-4b3f-9f9c-39daa84741a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7c16aa-44fc-498d-9732-678b438e7de7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942e4204-8409-4f9b-a587-2484bd0531c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Volume volume-2f7c16aa-44fc-498d-9732-678b438e7de7 (2f7c16aa-44fc-498d-9732-678b438e7de7): created successfully Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942e4204-8409-4f9b-a587-2484bd0531c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Flow 'volume_create_manager' (c54e5e38-400a-4dc0-ba0b-a998e6050e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fb8d476b-9f19-4a8a-b89e-1c743cf594f0 tempest-VolumesListAdminTestJSON-1665528116 None] Created volume successfully. Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "cinder-52d96976-45aa-4d45-85cc-033462367985-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-52d96976-45aa-4d45-85cc-033462367985-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:38 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:38 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c03c30-85f0-4ef4-82c5-d750f17c32d7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:38 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 1073741824" returned: 0 in 0.998s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:38 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 Nov 06 21:24:38 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:38 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.692s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:38 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 Nov 06 21:24:38 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:24:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Acquiring lock "cinder-2f7c16aa-44fc-498d-9732-678b438e7de7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "cinder-2f7c16aa-44fc-498d-9732-678b438e7de7-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:39 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Acquiring lock "cinder-quobyte-2f7c16aa-44fc-498d-9732-678b438e7de7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:39 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499dc5eb-541f-4977-a6d8-c89276a26bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9553d4e-4d07-4f30-9750-56737e40d0d5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb6ebad-ae18-4cea-b973-54d2ba02df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985" returned: 0 in 1.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Volume volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 (e9553d4e-4d07-4f30-9750-56737e40d0d5): created successfully Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb6ebad-ae18-4cea-b973-54d2ba02df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (b08e2b83-707d-4ed4-b8a6-d1080f59a391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "cinder-quobyte-2f7c16aa-44fc-498d-9732-678b438e7de7" acquired by "delete_volume" :: waited 0.211s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:39 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985 Nov 06 21:24:39 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-9c179292-7e91-40b3-ad9b-7d752c12b5c7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1fb25-5a1a-4bb8-877b-2326e46dc6fc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-9c179292-7e91-40b3-ad9b-7d752c12b5c7-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f7ff181b-033a-4aa5-8b95-a7fd23380bb0 tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:24:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-quobyte-9c179292-7e91-40b3-ad9b-7d752c12b5c7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-9c179292-7e91-40b3-ad9b-7d752c12b5c7" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614e797-2a59-4735-8046-7839cdf9a6a2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:40 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 Nov 06 21:24:40 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9b8f26f-0c97-42a4-8f57-453f766fa826 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5" by "attach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9b8f26f-0c97-42a4-8f57-453f766fa826 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5" acquired by "attach_volume" :: waited 0.062s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:40 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 Nov 06 21:24:40 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f9b8f26f-0c97-42a4-8f57-453f766fa826 tempest-VolumesActionsTest-1324238686 None] Attaching volume e9553d4e-4d07-4f30-9750-56737e40d0d5 to instance fa0facb2-4018-46ab-90f0-c9ab24508ee8 at mountpoint /dev/vdb on host None. Nov 06 21:24:40 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f9b8f26f-0c97-42a4-8f57-453f766fa826 tempest-VolumesActionsTest-1324238686 None] Attach volume completed successfully. Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d96976-45aa-4d45-85cc-033462367985" returned: 0 in 1.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f9b8f26f-0c97-42a4-8f57-453f766fa826 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5" released by "attach_volume" :: held 0.451s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-quobyte-52d96976-45aa-4d45-85cc-033462367985" released by "delete_volume" :: held 2.721s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:41 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7" returned: 0 in 1.377s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:41 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7 Nov 06 21:24:41 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Created reservations ['7b63e376-d961-402a-998f-8d43abf8ab4b', '36e3147f-3e25-4ece-8912-4a3d209c7fa7', '5b935ba5-4639-40ae-84ed-2863db5edf83', 'fe7b857f-8b27-4cec-ba41-7552ad1ccffd'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:41 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7" returned: 0 in 1.545s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:41 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7 Nov 06 21:24:41 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:41 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:41 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:42 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.474s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Deleted volume successfully. Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-17a454c4-8caf-4322-88ca-0ad901792883 tempest-VolumesSnapshotNegativeTestJSON-1895880457 None] Lock "cinder-52d96976-45aa-4d45-85cc-033462367985-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:42 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2f7c16aa-44fc-498d-9732-678b438e7de7" returned: 0 in 1.114s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "cinder-quobyte-2f7c16aa-44fc-498d-9732-678b438e7de7" released by "delete_volume" :: held 2.633s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:42 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-9c179292-7e91-40b3-ad9b-7d752c12b5c7" returned: 0 in 0.824s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Created reservations ['202d7406-7018-4dfd-925b-e2e7621d7fd8', '6065ec7a-49aa-4491-bc5f-171e6e14f9be', '03fbc403-9410-43cb-a94a-7dfed899b033', 'b8ab1789-4400-4939-b68d-44361a603b3c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-9c179292-7e91-40b3-ad9b-7d752c12b5c7" released by "delete_volume" :: held 2.520s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Created reservations ['95ab8969-84e7-42e5-93f0-4619f6af75d9', '67da0125-5481-44a2-b775-6b3305844ba0', 'c6d98e11-765a-4fdc-a271-2d6fa6c9cb60', '206b5a41-9820-455e-937f-71dd01a1c6ee'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:42 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:42 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:43 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:43 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Terminate volume connection completed successfully. Nov 06 21:24:43 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Deleted volume successfully. Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c1ce3f-5567-45b8-b119-7a8739469b5f tempest-VolumesListAdminTestJSON-1665528116 None] Lock "cinder-2f7c16aa-44fc-498d-9732-678b438e7de7-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" acquired by "detach_volume" :: waited 0.084s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:43 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.668s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Deleted volume successfully. Nov 06 21:24:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Detaching volume e9553d4e-4d07-4f30-9750-56737e40d0d5 from instance fa0facb2-4018-46ab-90f0-c9ab24508ee8. Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b02d233-6781-42fd-afc4-df2e9075e8dd tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-9c179292-7e91-40b3-ad9b-7d752c12b5c7-delete_volume" released by "delete_volume" :: held 3.984s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-b43d879a-ff3d-4fe9-aab9-18b1d30f78af-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Detach volume completed successfully. Nov 06 21:24:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a6093753-d6f6-4b3d-8c15-eba39455fbc7 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" released by "detach_volume" :: held 0.302s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-b43d879a-ff3d-4fe9-aab9-18b1d30f78af-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-quobyte-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" acquired by "delete_volume" :: waited 0.056s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8467b501-2717-4297-afbc-f27e1d48275b tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" by "detach_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3419fc-f88e-45c1-9546-c6c36a5bf77e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8467b501-2717-4297-afbc-f27e1d48275b tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8467b501-2717-4297-afbc-f27e1d48275b tempest-VolumesActionsTest-1324238686 None] Volume detach called, but volume not attached. Nov 06 21:24:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8467b501-2717-4297-afbc-f27e1d48275b tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:44 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af Nov 06 21:24:44 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:45 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:45 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af Nov 06 21:24:45 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-quobyte-e9553d4e-4d07-4f30-9750-56737e40d0d5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-quobyte-e9553d4e-4d07-4f30-9750-56737e40d0d5" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b892ea-378c-48d9-afae-c778a15be994]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:45 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" returned: 0 in 0.784s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:45 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 Nov 06 21:24:45 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-b43d879a-ff3d-4fe9-aab9-18b1d30f78af" released by "delete_volume" :: held 1.761s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Created reservations ['89beb767-f63f-4cdd-ab50-f37b54b8ebbb', '7ecc2bfa-a446-4ba7-aff7-0129049844e9', '70c9115a-5578-40c4-9e85-e08989db4c2d', '2d5c55e3-c743-4a97-9578-33c2f445efb9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5" returned: 0 in 0.793s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:46 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5 Nov 06 21:24:46 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-2ed22776-abd8-4da2-9f05-fc9177a3bd62-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-2ed22776-abd8-4da2-9f05-fc9177a3bd62-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "cinder-quobyte-2ed22776-abd8-4da2-9f05-fc9177a3bd62" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:47 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-2ed22776-abd8-4da2-9f05-fc9177a3bd62" acquired by "delete_volume" :: waited 0.058s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.846s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Deleted volume successfully. Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdda06d-ff3a-46ce-a2f6-0af57fcd3189]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:47 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e9553d4e-4d07-4f30-9750-56737e40d0d5" returned: 0 in 0.855s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9ef70550-2bdc-4be4-baf7-00ebea62bf78 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-b43d879a-ff3d-4fe9-aab9-18b1d30f78af-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-quobyte-e9553d4e-4d07-4f30-9750-56737e40d0d5" released by "delete_volume" :: held 1.862s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:47 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 Nov 06 21:24:47 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Created reservations ['d972251a-c66e-41c1-ae7c-0ede898d51bd', '065606f6-567d-4f97-be03-6d8a58a4a79f', 'ba796540-66d9-41dd-8944-7114a1df16fb', 'ac0fc07f-45ab-4c35-9bca-6f09c8c03075'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:47 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:47 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:48 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62" returned: 0 in 0.828s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:48 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62 Nov 06 21:24:48 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:48 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.794s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Deleted volume successfully. Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-10345a35-3257-4888-8e21-afdb93633340 tempest-VolumesActionsTest-1324238686 None] Lock "cinder-e9553d4e-4d07-4f30-9750-56737e40d0d5-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:48 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2ed22776-abd8-4da2-9f05-fc9177a3bd62" returned: 0 in 0.620s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-quobyte-2ed22776-abd8-4da2-9f05-fc9177a3bd62" released by "delete_volume" :: held 1.590s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Created reservations ['0d3768cc-dcc3-437b-9a74-419a4e777bc3', 'ba51ba98-6ea8-4db3-bd93-cd84c4615aa2', '03573716-e3c8-4945-9d2a-30b90d5f3413', '87f51c5a-4848-4123-bcb2-c37e159c2601'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:49 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:49 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:49 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.685s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Deleted volume successfully. Nov 06 21:24:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-be65c53a-505c-4a9e-8bc5-12cc53c8bab4 tempest-VolumesListAdminTestJSON-84271335 None] Lock "cinder-2ed22776-abd8-4da2-9f05-fc9177a3bd62-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (6557d3f1-75de-4379-9ef9-a414395a720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5c884-7536-46e4-a835-e78f01ca32ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df5c884-7536-46e4-a835-e78f01ca32ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123243362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf26250b-c9a1-48f7-af5e-decc8bfd0e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e7c5a-fa25-4415-94cc-dba6d13c57b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e7c5a-fa25-4415-94cc-dba6d13c57b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c8a21a-a26a-4f93-b00d-23228ed9ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c8a21a-a26a-4f93-b00d-23228ed9ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf26250b-c9a1-48f7-af5e-decc8bfd0e8d', 'volume_name': 'volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48bc29d-70df-4029-bc5a-7b2dbcb272e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48bc29d-70df-4029-bc5a-7b2dbcb272e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec1e5e6-0462-46c7-8382-8d3f81d365a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Volume cf26250b-c9a1-48f7-af5e-decc8bfd0e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d', 'volume_size': 1} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123243362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf26250b-c9a1-48f7-af5e-decc8bfd0e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Creating volume cf26250b-c9a1-48f7-af5e-decc8bfd0e8d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:53 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d 1073741824 Nov 06 21:24:53 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:54 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d 1073741824" returned: 0 in 0.704s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:54 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d Nov 06 21:24:54 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:54 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec1e5e6-0462-46c7-8382-8d3f81d365a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4a48e-fb4c-4aed-aaf2-a2fd4bcd1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Volume volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d (cf26250b-c9a1-48f7-af5e-decc8bfd0e8d): created successfully Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4a48e-fb4c-4aed-aaf2-a2fd4bcd1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (6557d3f1-75de-4379-9ef9-a414395a720f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-24c8ad4d-4bed-4d09-b593-9f2770db8243 tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "cinder-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-quobyte-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dede78-a005-4b37-af0f-29ad73e944e3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:55 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d Nov 06 21:24:55 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:56 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" returned: 0 in 0.455s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:56 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d Nov 06 21:24:56 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:56 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" returned: 0 in 0.264s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d" released by "delete_volume" :: held 0.766s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Created reservations ['27e5d6a5-3284-40aa-91a6-8aba22b0d5f0', 'cd9e4468-19ec-4549-a50a-d414cf2dc62c', '9c8fe882-6dce-40b0-866a-ffca7f22cc53', '4c6411fe-38f9-4840-8085-e065a2c4a91d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:56 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:24:56 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:56 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Deleted volume successfully. Nov 06 21:24:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e766d50f-3754-4fa8-b12f-ca784763e1fb tempest-VolumesActionsTest-1391147607 None] Lock "cinder-cf26250b-c9a1-48f7-af5e-decc8bfd0e8d-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (f8ab2d1a-4a66-4772-bcfc-79bf8d9cc794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ae0f5-0f7c-4408-adae-a003c649244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ae0f5-0f7c-4408-adae-a003c649244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1271376265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693bb4a-3702-4012-b320-0b9c0428a53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:57Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c0109-f7b6-4c96-9f01-ee9ba5c2d4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c0109-f7b6-4c96-9f01-ee9ba5c2d4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc27c55-e36a-4078-b7b5-fe68ce05915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc27c55-e36a-4078-b7b5-fe68ce05915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd693bb4a-3702-4012-b320-0b9c0428a53a', 'volume_name': 'volume-d693bb4a-3702-4012-b320-0b9c0428a53a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0eb17f-121f-4fbc-9ef3-545a48c238aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0eb17f-121f-4fbc-9ef3-545a48c238aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3637ff81-c223-403d-8ddf-279e120054ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Volume d693bb4a-3702-4012-b320-0b9c0428a53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d693bb4a-3702-4012-b320-0b9c0428a53a', 'volume_size': 1} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1271376265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693bb4a-3702-4012-b320-0b9c0428a53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:57Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Creating volume d693bb4a-3702-4012-b320-0b9c0428a53a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:57 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:57 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a 1073741824 Nov 06 21:24:57 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:58 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a 1073741824" returned: 0 in 0.626s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:58 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a Nov 06 21:24:58 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Flow 'volume_create_manager' (39ac1871-8683-4a8d-80ae-967d081f143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69acd8a6-9049-432a-be89-e3986d3153f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69acd8a6-9049-432a-be89-e3986d3153f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1108173681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c13722-8539-46fb-9b08-5055ea0f5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9707c9e68453582c7fbf052a5bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:58Z,use_quota=True,user_id='4cdabf3483ce4cb28cf1106c73873bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5900ca-a3b2-4209-ae9d-698c08eb6b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5900ca-a3b2-4209-ae9d-698c08eb6b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06198575-d149-47cc-8132-5848b6f13812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06198575-d149-47cc-8132-5848b6f13812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c13722-8539-46fb-9b08-5055ea0f5281', 'volume_name': 'volume-66c13722-8539-46fb-9b08-5055ea0f5281', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957860c9-8a4e-4fcf-8159-776106c61333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957860c9-8a4e-4fcf-8159-776106c61333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9198a9-9e36-4cdc-b129-87876440425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Volume 66c13722-8539-46fb-9b08-5055ea0f5281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c13722-8539-46fb-9b08-5055ea0f5281', 'volume_size': 1} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:58 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1108173681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c13722-8539-46fb-9b08-5055ea0f5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9707c9e68453582c7fbf052a5bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:58Z,use_quota=True,user_id='4cdabf3483ce4cb28cf1106c73873bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Creating volume 66c13722-8539-46fb-9b08-5055ea0f5281 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:58 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:58 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 1073741824 Nov 06 21:24:58 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3637ff81-c223-403d-8ddf-279e120054ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d693bb4a-3702-4012-b320-0b9c0428a53a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fe0a48-c351-461a-8cad-3b25d6e18852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Volume volume-d693bb4a-3702-4012-b320-0b9c0428a53a (d693bb4a-3702-4012-b320-0b9c0428a53a): created successfully Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fe0a48-c351-461a-8cad-3b25d6e18852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (f8ab2d1a-4a66-4772-bcfc-79bf8d9cc794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4b804e29-eb7b-4396-af4e-f1d777401d0a tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:24:59 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 1073741824" returned: 0 in 0.612s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:59 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 Nov 06 21:24:59 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:59 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281" returned: 0 in 0.389s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9198a9-9e36-4cdc-b129-87876440425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c13722-8539-46fb-9b08-5055ea0f5281', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66e6ac9-01e2-4732-b7af-b8e2736460ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Volume volume-66c13722-8539-46fb-9b08-5055ea0f5281 (66c13722-8539-46fb-9b08-5055ea0f5281): created successfully Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66e6ac9-01e2-4732-b7af-b8e2736460ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Flow 'volume_create_manager' (39ac1871-8683-4a8d-80ae-967d081f143a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f986fd6f-6916-4d4b-b398-cd5036385d9b tempest-AbsoluteLimitsTests-1970888816 None] Created volume successfully. Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-d693bb4a-3702-4012-b320-0b9c0428a53a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-d693bb4a-3702-4012-b320-0b9c0428a53a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-quobyte-d693bb4a-3702-4012-b320-0b9c0428a53a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-d693bb4a-3702-4012-b320-0b9c0428a53a" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb38dc5-5af6-4fd8-b4ad-adf91ce0ccd3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:00 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a Nov 06 21:25:00 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:00 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a" returned: 0 in 0.592s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:00 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a Nov 06 21:25:00 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Acquiring lock "cinder-66c13722-8539-46fb-9b08-5055ea0f5281-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "cinder-66c13722-8539-46fb-9b08-5055ea0f5281-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Acquiring lock "cinder-quobyte-66c13722-8539-46fb-9b08-5055ea0f5281" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "cinder-quobyte-66c13722-8539-46fb-9b08-5055ea0f5281" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:01 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d693bb4a-3702-4012-b320-0b9c0428a53a" returned: 0 in 0.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[333adf45-2628-4593-977d-5d177ec07936]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-d693bb4a-3702-4012-b320-0b9c0428a53a" released by "delete_volume" :: held 1.165s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Created reservations ['2c706147-9b5a-4b2b-9f95-cd5644938426', '41511bdc-6f81-42af-b906-b33a9b3f3050', 'c47658ca-4352-4811-a41a-fc6d3e0b9501', '7a79f7ea-0416-4635-9918-bc29e226beb1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:01 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 Nov 06 21:25:01 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:01 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:01 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:01 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281" returned: 0 in 0.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:01 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.331s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:01 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281 Nov 06 21:25:01 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Deleted volume successfully. Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-66234fd9-6907-4ede-9ed0-abc6be63b4f4 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-d693bb4a-3702-4012-b320-0b9c0428a53a-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:01 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-66c13722-8539-46fb-9b08-5055ea0f5281" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "cinder-quobyte-66c13722-8539-46fb-9b08-5055ea0f5281" released by "delete_volume" :: held 0.949s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Created reservations ['0179f4a4-cd3c-4186-a15d-473f1e1061aa', '1e290e80-0749-4bd1-93a0-df26cec06811', '54530572-f2fa-476b-9c70-b02f1643c991', '257adcc0-5e40-4677-897b-2e120de6c363'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:02 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:02 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:02 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Deleted volume successfully. Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50ff98a2-7a3d-4dd0-afef-ef07cba7a7be tempest-AbsoluteLimitsTests-1970888816 None] Lock "cinder-66c13722-8539-46fb-9b08-5055ea0f5281-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (0262914f-216d-4709-aac1-cba612871db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b374bc5c-6ea3-4e48-8101-6244a6891991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b374bc5c-6ea3-4e48-8101-6244a6891991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1457558041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d502d5-194e-415c-91f2-813e1cb83471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:03Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd0339b-7d7e-48b5-b717-2b9a9aa90edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd0339b-7d7e-48b5-b717-2b9a9aa90edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a23ed4b-4afb-4718-beca-db9b48452c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a23ed4b-4afb-4718-beca-db9b48452c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d502d5-194e-415c-91f2-813e1cb83471', 'volume_name': 'volume-23d502d5-194e-415c-91f2-813e1cb83471', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb9a96-f7e1-46bd-8acc-c355621f3257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb9a96-f7e1-46bd-8acc-c355621f3257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efda9df-6990-4817-90b8-ef838d9acd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Volume 23d502d5-194e-415c-91f2-813e1cb83471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d502d5-194e-415c-91f2-813e1cb83471', 'volume_size': 1} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1457558041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d502d5-194e-415c-91f2-813e1cb83471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:03Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Creating volume 23d502d5-194e-415c-91f2-813e1cb83471 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:03 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 1073741824 Nov 06 21:25:03 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:03 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 1073741824" returned: 0 in 0.779s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:03 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 Nov 06 21:25:03 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:04 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471" returned: 0 in 0.467s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efda9df-6990-4817-90b8-ef838d9acd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d502d5-194e-415c-91f2-813e1cb83471', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f620dbba-123b-481a-8516-81bd3b48c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Volume volume-23d502d5-194e-415c-91f2-813e1cb83471 (23d502d5-194e-415c-91f2-813e1cb83471): created successfully Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f620dbba-123b-481a-8516-81bd3b48c12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (0262914f-216d-4709-aac1-cba612871db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b3136327-ffcf-4af8-8e54-2ab023bd69b0 tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-23d502d5-194e-415c-91f2-813e1cb83471-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "cinder-23d502d5-194e-415c-91f2-813e1cb83471-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-quobyte-23d502d5-194e-415c-91f2-813e1cb83471" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-23d502d5-194e-415c-91f2-813e1cb83471" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3cf90e-9958-46e1-9f65-21937e731393]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 Nov 06 21:25:05 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:05 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471" returned: 0 in 0.518s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471 Nov 06 21:25:06 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-23d502d5-194e-415c-91f2-813e1cb83471" returned: 0 in 0.404s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-23d502d5-194e-415c-91f2-813e1cb83471" released by "delete_volume" :: held 0.999s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Created reservations ['b5f274af-c4ec-42f1-a947-a917d65e7f59', 'f6f4b9ff-b650-4f01-b302-5ce02fb47b6b', 'cbbb50eb-95c5-489a-ab2c-ac912c103986', 'c7e1f6a0-7bb2-42e5-92f5-dafb77c25560'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:06 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-41117a35-8aa2-41ac-b938-8f5aef40b0aa req-e5d37967-b182-4097-b707-9b0e3c20a0c5 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-41117a35-8aa2-41ac-b938-8f5aef40b0aa req-e5d37967-b182-4097-b707-9b0e3c20a0c5 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-41117a35-8aa2-41ac-b938-8f5aef40b0aa req-e5d37967-b182-4097-b707-9b0e3c20a0c5 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-41117a35-8aa2-41ac-b938-8f5aef40b0aa req-e5d37967-b182-4097-b707-9b0e3c20a0c5 tempest-TestInstancesWithCinderVolumes-1404121332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-848d1981-5c59-4585-8cd0-45076343e167', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '566af759-32ec-4387-a664-7c9f591848df', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:25:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-41117a35-8aa2-41ac-b938-8f5aef40b0aa req-e5d37967-b182-4097-b707-9b0e3c20a0c5 tempest-TestInstancesWithCinderVolumes-1404121332 None] attachment_update completed successfully. Nov 06 21:25:07 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.406s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Deleted volume successfully. Nov 06 21:25:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e00fc0b-31bf-4f9e-99f6-8425288addec tempest-VolumesActionsTest-1391147607 None] Lock "cinder-23d502d5-194e-415c-91f2-813e1cb83471-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (04445058-ad6c-4ce4-940c-aade2f6db257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d1af3c-3a48-4eca-b441-5325e7925a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d1af3c-3a48-4eca-b441-5325e7925a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108132615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa037719-67d1-48e3-a4cf-0c0849040810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:08Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2076cbf-b8e2-43ae-a1cd-ff18a914b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2076cbf-b8e2-43ae-a1cd-ff18a914b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05efab3e-5eb4-4158-9fc1-521f7ed46014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05efab3e-5eb4-4158-9fc1-521f7ed46014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa037719-67d1-48e3-a4cf-0c0849040810', 'volume_name': 'volume-aa037719-67d1-48e3-a4cf-0c0849040810', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383eef59-434b-473f-b25f-5a264ebb9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383eef59-434b-473f-b25f-5a264ebb9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50593a87-a10c-43d6-8fac-220d1052a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Volume aa037719-67d1-48e3-a4cf-0c0849040810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa037719-67d1-48e3-a4cf-0c0849040810', 'volume_size': 1} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108132615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa037719-67d1-48e3-a4cf-0c0849040810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:08Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Creating volume aa037719-67d1-48e3-a4cf-0c0849040810 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:08 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 1073741824 Nov 06 21:25:08 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 1073741824" returned: 0 in 0.642s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 Nov 06 21:25:09 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810" returned: 0 in 0.402s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50593a87-a10c-43d6-8fac-220d1052a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa037719-67d1-48e3-a4cf-0c0849040810', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01982777-3564-42f9-89cf-cbca3610ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Volume volume-aa037719-67d1-48e3-a4cf-0c0849040810 (aa037719-67d1-48e3-a4cf-0c0849040810): created successfully Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01982777-3564-42f9-89cf-cbca3610ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (04445058-ad6c-4ce4-940c-aade2f6db257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c0c34536-2ace-4eb1-9115-beb20dcb25cf tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:25:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-adfeaefb-01af-41cd-8baa-e4e32d6850f0 req-c941704f-39fa-4515-b8c2-e5fd774a1d2c tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-adfeaefb-01af-41cd-8baa-e4e32d6850f0 req-c941704f-39fa-4515-b8c2-e5fd774a1d2c tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-adfeaefb-01af-41cd-8baa-e4e32d6850f0 req-c941704f-39fa-4515-b8c2-e5fd774a1d2c tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-adfeaefb-01af-41cd-8baa-e4e32d6850f0 req-c941704f-39fa-4515-b8c2-e5fd774a1d2c tempest-TestInstancesWithCinderVolumes-1404121332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-300db7dc-5ed6-4079-a40b-b8c14e602125', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8f94166-846d-4ba0-812b-3076f68ec853', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:25:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-adfeaefb-01af-41cd-8baa-e4e32d6850f0 req-c941704f-39fa-4515-b8c2-e5fd774a1d2c tempest-TestInstancesWithCinderVolumes-1404121332 None] attachment_update completed successfully. Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-aa037719-67d1-48e3-a4cf-0c0849040810-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-aa037719-67d1-48e3-a4cf-0c0849040810-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "cinder-quobyte-aa037719-67d1-48e3-a4cf-0c0849040810" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-aa037719-67d1-48e3-a4cf-0c0849040810" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2012bd2-f688-4536-b723-4d5d7e9ec248]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (9ae03365-6989-47c1-8f40-872b00fbfb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19160aab-df68-4767-9c73-c3e6c529d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19160aab-df68-4767-9c73-c3e6c529d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848111478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2741bd1e-7adf-4a3c-98dc-41e73bb28870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a52e4b7c0148c2a7b7cc2f4eee8908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:11Z,use_quota=True,user_id='bdc53ecc0f584bbf9d2c5238a6ff06d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee3b1ff-c7fc-4572-a48e-e2a36edd98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee3b1ff-c7fc-4572-a48e-e2a36edd98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713adbce-194e-4a8b-bc02-32c510e4b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713adbce-194e-4a8b-bc02-32c510e4b586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2741bd1e-7adf-4a3c-98dc-41e73bb28870', 'volume_name': 'volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cd78c6-6775-4c38-8eff-ace8524d3153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cd78c6-6775-4c38-8eff-ace8524d3153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847aa27e-f09a-4cbb-92b2-9122fec744af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870', 'volume_size': 1} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848111478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2741bd1e-7adf-4a3c-98dc-41e73bb28870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a52e4b7c0148c2a7b7cc2f4eee8908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:11Z,use_quota=True,user_id='bdc53ecc0f584bbf9d2c5238a6ff06d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Creating volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:11 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 Nov 06 21:25:11 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 1073741824 Nov 06 21:25:11 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810 Nov 06 21:25:11 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 1073741824" returned: 0 in 0.689s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-aa037719-67d1-48e3-a4cf-0c0849040810" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 Nov 06 21:25:12 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-quobyte-aa037719-67d1-48e3-a4cf-0c0849040810" released by "delete_volume" :: held 1.058s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Created reservations ['ca15ea39-a43c-48d7-bb19-8188eb118f6b', '2774a1b2-65aa-475b-ab51-6693ebf80d74', 'ed90ac04-4e0a-45a6-a939-c49a64b8ce39', '3fb94fb4-789c-49a7-959a-e19d7eb04c42'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:12 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847aa27e-f09a-4cbb-92b2-9122fec744af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcf91fe-a33d-4ee4-8c53-bc06e4a42bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Volume volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 (2741bd1e-7adf-4a3c-98dc-41e73bb28870): created successfully Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcf91fe-a33d-4ee4-8c53-bc06e4a42bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (9ae03365-6989-47c1-8f40-872b00fbfb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d207b21-c261-461b-bfbd-7ef5bab226dc tempest-VolumesDeleteCascade-1203075400 None] Created volume successfully. Nov 06 21:25:12 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Deleted volume successfully. Nov 06 21:25:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b8678489-1b92-43ca-8bae-a5a94919c478 tempest-VolumesActionsTest-1391147607 None] Lock "cinder-aa037719-67d1-48e3-a4cf-0c0849040810-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Creating offline snapshot 81c2e8f8-c0d7-4e50-941d-b5ca038c7982 of volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3cc30-a33c-47e6-bebb-2acd46b45385]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 Nov 06 21:25:13 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870" returned: 0 in 0.540s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 1G Nov 06 21:25:14 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (4a17368d-b6e4-46b2-814e-ff7837215ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f550f69-811c-4bd8-bb18-e3a83b68b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f550f69-811c-4bd8-bb18-e3a83b68b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822470502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d7748b-27c8-4ca2-bb2c-861f0070fb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:14Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3793673c-2eb3-49fd-835b-cac584fb64c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3793673c-2eb3-49fd-835b-cac584fb64c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40159581-159f-4718-a980-3dca9ae12283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40159581-159f-4718-a980-3dca9ae12283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d7748b-27c8-4ca2-bb2c-861f0070fb36', 'volume_name': 'volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2929259c-1f0e-41d0-a0ca-e84edac2bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2929259c-1f0e-41d0-a0ca-e84edac2bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fa83dc-bb9f-4d66-9fea-677a695afd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Volume 24d7748b-27c8-4ca2-bb2c-861f0070fb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36', 'volume_size': 1} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:14 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 1G" returned: 0 in 0.535s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:14 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 is being set with open permissions: ugo+rw Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:15 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info Nov 06 21:25:15 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info" returned: 0 in 0.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info is being set with open permissions: ugo+rw Nov 06 21:25:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info Nov 06 21:25:15 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.info" returned: 0 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822470502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d7748b-27c8-4ca2-bb2c-861f0070fb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c5f4a0fa1048a5b414168a0b831755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:14Z,use_quota=True,user_id='581ee105c77949fc83bf6b74d3f94757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Creating volume 24d7748b-27c8-4ca2-bb2c-861f0070fb36 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9ae56d29-9711-4069-822a-b29ec5e94488 tempest-VolumesDeleteCascade-1203075400 None] Create snapshot completed successfully Nov 06 21:25:16 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 1073741824 Nov 06 21:25:16 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 1073741824" returned: 0 in 0.691s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 Nov 06 21:25:17 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:17 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36" returned: 0 in 0.381s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.290s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fa83dc-bb9f-4d66-9fea-677a695afd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120edfb3-4758-4525-abe7-dba83e7235ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Creating offline snapshot 01de160c-6195-45ef-bc7e-b34d9b88a3b7 of volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[684919a0-e6d8-4d4c-9f06-4a853ef89d7b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Volume volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 (24d7748b-27c8-4ca2-bb2c-861f0070fb36): created successfully Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120edfb3-4758-4525-abe7-dba83e7235ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Flow 'volume_create_manager' (4a17368d-b6e4-46b2-814e-ff7837215ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-41831b87-4f25-44cf-8a99-a2ec1795527a tempest-VolumesActionsTest-1324238686 None] Created volume successfully. Nov 06 21:25:17 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:17 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-34865180-64d3-48ff-8e1d-29c8c5996972 req-2ad25bb3-82cb-464d-a253-485ae1edf115 tempest-TestInstancesWithCinderVolumes-1404121332 None] Terminate volume connection completed successfully. Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-34865180-64d3-48ff-8e1d-29c8c5996972 req-2ad25bb3-82cb-464d-a253-485ae1edf115 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleting attachment 566af759-32ec-4387-a664-7c9f591848df. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:25:17 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 1G Nov 06 21:25:17 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-848d1981-5c59-4585-8cd0-45076343e167-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-848d1981-5c59-4585-8cd0-45076343e167-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-quobyte-848d1981-5c59-4585-8cd0-45076343e167" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-848d1981-5c59-4585-8cd0-45076343e167" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe7759e-4f39-4e36-9025-66fc491d4522]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:18 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 1G" returned: 0 in 0.596s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:18 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 Nov 06 21:25:18 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 Nov 06 21:25:18 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7" returned: 0 in 0.485s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:18 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 is being set with open permissions: ugo+rw Nov 06 21:25:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 Nov 06 21:25:19 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167" returned: 0 in 0.604s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167 Nov 06 21:25:19 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7" returned: 0 in 0.429s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-848d1981-5c59-4585-8cd0-45076343e167" returned: 0 in 0.345s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-848d1981-5c59-4585-8cd0-45076343e167" released by "delete_volume" :: held 1.043s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-066c87d2-e82f-426c-b123-1f783d6cb14d tempest-VolumesDeleteCascade-1203075400 None] Create snapshot completed successfully Nov 06 21:25:19 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741845762-1375738595 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741845762-1375738595, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:19 devstack cinder-volume[87230]: WARNING cinder.quota [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741845762-1375738595 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741845762-1375738595, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Created reservations ['0f0e1964-68ab-4ef7-8416-1d4f2ac97eea', 'd24e2e62-2f6a-462d-9bc0-f69cfcadd1d1', 'af205bd2-2ec2-4e73-8ae3-60e467d7fd26', '65729fae-28b2-43e5-a62e-5d04e7882d7e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-24d7748b-27c8-4ca2-bb2c-861f0070fb36-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "cinder-24d7748b-27c8-4ca2-bb2c-861f0070fb36-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Acquiring lock "cinder-quobyte-24d7748b-27c8-4ca2-bb2c-861f0070fb36" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "cinder-quobyte-24d7748b-27c8-4ca2-bb2c-861f0070fb36" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2a312-000b-4cb5-a36d-5f897ff1b896]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:19 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:19 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 Nov 06 21:25:20 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleted volume successfully. Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7eddfc-ac8f-4bc4-9b00-920f568c16b9 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-848d1981-5c59-4585-8cd0-45076343e167-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-2741bd1e-7adf-4a3c-98dc-41e73bb28870-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-2741bd1e-7adf-4a3c-98dc-41e73bb28870-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Performing cascade delete. {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1007}} Nov 06 21:25:20 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36" returned: 0 in 0.701s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-01de160c-6195-45ef-bc7e-b34d9b88a3b7-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36 Nov 06 21:25:20 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-01de160c-6195-45ef-bc7e-b34d9b88a3b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-01de160c-6195-45ef-bc7e-b34d9b88a3b7" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-01de160c-6195-45ef-bc7e-b34d9b88a3b7" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Deleting offline snapshot 01de160c-6195-45ef-bc7e-b34d9b88a3b7 of volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] snapshot_file for this snap is: volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511f234-367b-492d-b639-2c71e1e1b8f1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:20 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-24d7748b-27c8-4ca2-bb2c-861f0070fb36" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "cinder-quobyte-24d7748b-27c8-4ca2-bb2c-861f0070fb36" released by "delete_volume" :: held 1.174s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:20 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 Nov 06 21:25:20 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Created reservations ['55005d21-8f06-4b3a-8bc5-a9f7afb027b5', 'b53d7971-1b41-4af5-8bd3-84e04cf9000b', '9e29e051-0697-482c-b00c-8a78466d85b9', 'f9253fda-a45a-43a5-9558-68b1e4f62fe6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:21 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:21 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:21 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[700f37b5-cc71-4260-9e30-0a03f60e8b57]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:21 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:21 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:21 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Deleted volume successfully. Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f5f48957-6f25-4a53-a724-f7eb38c880ae tempest-VolumesActionsTest-1324238686 None] Lock "cinder-24d7748b-27c8-4ca2-bb2c-861f0070fb36-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:21 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.525s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:21 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 Nov 06 21:25:21 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7" returned: 0 in 0.539s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:22 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7 Nov 06 21:25:22 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.01de160c-6195-45ef-bc7e-b34d9b88a3b7" returned: 0 in 0.444s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-01de160c-6195-45ef-bc7e-b34d9b88a3b7" released by "_delete_snapshot" :: held 2.183s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" released by "delete_snapshot" :: held 2.234s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=151,cinder:UPDATE=160,cinder:DELETE=14,cinder:INSERT=34 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:22 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=123,cinder:INSERT=39,cinder:UPDATE=162,cinder:DELETE=15 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['b4e28192-d557-4377-9794-a2e362e3a04d', 'db5b7ebe-ca6e-44fe-a1f1-3ff3e556b32d', '3a41aeff-0a97-4d6f-8897-08dc8d93790f', '41a3f0b1-81e5-4a64-a3ce-711a7cad9eb8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Delete snapshot completed successfully. Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-01de160c-6195-45ef-bc7e-b34d9b88a3b7-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-81c2e8f8-c0d7-4e50-941d-b5ca038c7982-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-81c2e8f8-c0d7-4e50-941d-b5ca038c7982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-81c2e8f8-c0d7-4e50-941d-b5ca038c7982" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-81c2e8f8-c0d7-4e50-941d-b5ca038c7982" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Deleting offline snapshot 81c2e8f8-c0d7-4e50-941d-b5ca038c7982 of volume 2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] snapshot_file for this snap is: volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ac4a9-df1b-4926-96af-6ff48b2685f9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-1fc13e8a-b9af-4cba-adaf-ee76e0d40afa req-c5d1c2cf-4055-4ff3-b96c-4e60d5089b2a tempest-TestInstancesWithCinderVolumes-1404121332 None] Terminate volume connection completed successfully. Nov 06 21:25:23 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:23 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-1fc13e8a-b9af-4cba-adaf-ee76e0d40afa req-c5d1c2cf-4055-4ff3-b96c-4e60d5089b2a tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleting attachment f8f94166-846d-4ba0-812b-3076f68ec853. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:25:23 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.592s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5956578f-55c3-4edf-9a47-43d98e613139]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:24 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 Nov 06 21:25:24 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-300db7dc-5ed6-4079-a40b-b8c14e602125-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-300db7dc-5ed6-4079-a40b-b8c14e602125-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-quobyte-300db7dc-5ed6-4079-a40b-b8c14e602125" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-300db7dc-5ed6-4079-a40b-b8c14e602125" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797d0a2-2f2d-4d5a-a234-4f7e5184f393]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:24 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870" returned: 0 in 0.591s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:24 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 Nov 06 21:25:24 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:24 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:24 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:24 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125" returned: 0 in 0.649s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125 Nov 06 21:25:25 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.533s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982 Nov 06 21:25:25 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-300db7dc-5ed6-4079-a40b-b8c14e602125" returned: 0 in 0.330s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-300db7dc-5ed6-4079-a40b-b8c14e602125" released by "delete_volume" :: held 1.049s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:25 devstack cinder-volume[87230]: WARNING cinder.quota [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295908195-683293962 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295908195-683293962, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:25 devstack cinder-volume[87230]: WARNING cinder.quota [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295908195-683293962 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295908195-683293962, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:25 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870.81c2e8f8-c0d7-4e50-941d-b5ca038c7982" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-81c2e8f8-c0d7-4e50-941d-b5ca038c7982" released by "_delete_snapshot" :: held 2.192s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" released by "delete_snapshot" :: held 2.224s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Created reservations ['e3fc2c4e-fb7f-47f8-b419-644d4bf16ad1', '1d33c9aa-413b-489a-b58c-2d2714315e40', 'aa541c67-3bf3-4789-90e9-1b526012f044', 'afc40988-da69-4208-b9a1-f1d1859a2def'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['c914584e-b7cf-4404-8b96-3c9126f72971', '4b20c743-e134-4c35-ac1d-c66c5360e7f1', '5fd1e05f-c485-4f60-a45a-25f57d109066', '5e61cccd-e98b-4077-8b59-9232e429c60c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:25 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:25 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Delete snapshot completed successfully. Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-81c2e8f8-c0d7-4e50-941d-b5ca038c7982-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Snapshots deleted, issuing volume delete {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1022}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc86763-ad14-474a-bd11-e04cf34063de]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:26 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 Nov 06 21:25:26 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleted volume successfully. Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-af089485-2fcb-4b73-8bff-5b554ee2a6cb tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-300db7dc-5ed6-4079-a40b-b8c14e602125-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870" returned: 0 in 0.477s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870 Nov 06 21:25:26 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:26 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2741bd1e-7adf-4a3c-98dc-41e73bb28870" returned: 0 in 0.311s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-2741bd1e-7adf-4a3c-98dc-41e73bb28870" released by "delete_volume" :: held 0.921s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['16cda89f-850c-48a3-af77-ecc138acd9fa', 'a6adb3d8-ccdc-41d3-a2c3-182927898720', '223a5296-b688-42a0-bad7-a52e426fee66', '7be85dc9-f43c-4d76-b39e-7aad549945c7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:26 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:26 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:27 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Deleted volume successfully. Nov 06 21:25:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b140b623-f036-40cc-ad24-c2680a4df6d2 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-2741bd1e-7adf-4a3c-98dc-41e73bb28870-delete_volume" released by "delete_volume" :: held 6.743s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (4687fb06-0020-4293-8e15-989c359c0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a47eca6-ecff-47de-a6f5-43af21e0e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a47eca6-ecff-47de-a6f5-43af21e0e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-118643054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb26b1cb-2c90-4d49-acdf-d3900bb3411d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a52e4b7c0148c2a7b7cc2f4eee8908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:29Z,use_quota=True,user_id='bdc53ecc0f584bbf9d2c5238a6ff06d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd996be5-474e-4560-ad8c-8e4f4893f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd996be5-474e-4560-ad8c-8e4f4893f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a1d25f-3eb7-491a-9d1d-3fc99161d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a1d25f-3eb7-491a-9d1d-3fc99161d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb26b1cb-2c90-4d49-acdf-d3900bb3411d', 'volume_name': 'volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e990140d-e725-4785-9b19-a0d62c8d67ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e990140d-e725-4785-9b19-a0d62c8d67ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc735646-bd77-4233-8270-3a2aa6b6e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Volume bb26b1cb-2c90-4d49-acdf-d3900bb3411d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d', 'volume_size': 1} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-118643054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb26b1cb-2c90-4d49-acdf-d3900bb3411d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a52e4b7c0148c2a7b7cc2f4eee8908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:29Z,use_quota=True,user_id='bdc53ecc0f584bbf9d2c5238a6ff06d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Creating volume bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:29 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d 1073741824 Nov 06 21:25:29 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:29 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d 1073741824" returned: 0 in 0.824s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:29 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:29 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:30 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc735646-bd77-4233-8270-3a2aa6b6e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58a484-9566-48fa-b303-6fa39adab485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Volume volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d (bb26b1cb-2c90-4d49-acdf-d3900bb3411d): created successfully Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58a484-9566-48fa-b303-6fa39adab485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (4687fb06-0020-4293-8e15-989c359c0761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-40d4e941-9e41-4ed2-b05b-202f7b4bf3b9 tempest-VolumesDeleteCascade-1203075400 None] Created volume successfully. Nov 06 21:25:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-86e8f2ea-dde0-4fab-8292-9543224f44ea req-a16ad733-cc86-40bf-81e8-7a444f973165 tempest-TestInstancesWithCinderVolumes-1404121332 None] Terminate volume connection completed successfully. Nov 06 21:25:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-86e8f2ea-dde0-4fab-8292-9543224f44ea req-a16ad733-cc86-40bf-81e8-7a444f973165 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleting attachment 0e6ddaa9-2eb4-42e7-95c5-bb7faba8f434. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Creating offline snapshot 15f36461-5339-4cd6-89e7-01a3c6233165 of volume bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3b875-5099-4c59-801c-dfeec2941da2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:31 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-b948c00d-bd6a-495d-9d66-0927d7c999ce-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:31 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-b948c00d-bd6a-495d-9d66-0927d7c999ce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.553s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 1G Nov 06 21:25:31 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "cinder-quobyte-b948c00d-bd6a-495d-9d66-0927d7c999ce" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-b948c00d-bd6a-495d-9d66-0927d7c999ce" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c73b0e-0477-4d5a-b131-7fb66cf9e169]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce Nov 06 21:25:32 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce" returned: 0 in 0.533s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce Nov 06 21:25:32 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 1G" returned: 0 in 0.752s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:32 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b948c00d-bd6a-495d-9d66-0927d7c999ce" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-quobyte-b948c00d-bd6a-495d-9d66-0927d7c999ce" released by "delete_volume" :: held 0.961s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:32 devstack cinder-volume[87230]: WARNING cinder.quota [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1338889178-1027725442 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1338889178-1027725442, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:32 devstack cinder-volume[87230]: WARNING cinder.quota [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1338889178-1027725442 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1338889178-1027725442, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Created reservations ['18f70dd4-9423-4699-b0f7-e2cb125ce266', 'ba2846f3-230e-4d0e-8e3c-2dc14858a6cf', '52a3a6c8-19fe-4d25-8901-9b545f11acc3', '38607a4d-c992-4258-b4e9-d5d0b32eeebf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:33 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.446s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 is being set with open permissions: ugo+rw Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:33 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:33 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.362s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info Nov 06 21:25:33 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.392s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Deleted volume successfully. Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-78be38c7-fa14-474e-bad5-9faf41288418 tempest-TestInstancesWithCinderVolumes-1404121332 None] Lock "cinder-b948c00d-bd6a-495d-9d66-0927d7c999ce-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:33 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info is being set with open permissions: ugo+rw Nov 06 21:25:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info Nov 06 21:25:33 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.info" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1acb6cfd-ac9d-4770-a8c2-fa067588cfd2 tempest-VolumesDeleteCascade-1203075400 None] Create snapshot completed successfully Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (0349fab3-001b-4ff8-9482-59d88d11c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0463099f-8233-4606-8df1-e8f296252ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0463099f-8233-4606-8df1-e8f296252ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-54021016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17779a63-5661-4528-a14a-d9c953b302dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a52e4b7c0148c2a7b7cc2f4eee8908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15f36461-5339-4cd6-89e7-01a3c6233165,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:36Z,use_quota=True,user_id='bdc53ecc0f584bbf9d2c5238a6ff06d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bb9c71-9f5f-4ac8-addc-fcbfdb328ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bb9c71-9f5f-4ac8-addc-fcbfdb328ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac66814b-9d95-4d2e-9a24-bcdf091a5d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac66814b-9d95-4d2e-9a24-bcdf091a5d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17779a63-5661-4528-a14a-d9c953b302dc', 'volume_name': 'volume-17779a63-5661-4528-a14a-d9c953b302dc', 'volume_size': 1, 'snapshot_id': '15f36461-5339-4cd6-89e7-01a3c6233165'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28b8bd2-beb0-4faa-a790-3db0e6a13c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28b8bd2-beb0-4faa-a790-3db0e6a13c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae52a7b-54b0-4d45-8c60-fd243f1e8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:35 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Volume 17779a63-5661-4528-a14a-d9c953b302dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17779a63-5661-4528-a14a-d9c953b302dc', 'volume_size': 1, 'snapshot_id': '15f36461-5339-4cd6-89e7-01a3c6233165'} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165-17779a63-5661-4528-a14a-d9c953b302dc" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165-17779a63-5661-4528-a14a-d9c953b302dc" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Creating volume 17779a63-5661-4528-a14a-d9c953b302dc from snapshot 15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] snapshot: 15f36461-5339-4cd6-89e7-01a3c6233165, volume: 17779a63-5661-4528-a14a-d9c953b302dc, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600b10a-b408-4c77-b3cf-95f1909fd4cb]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:36 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:36 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:36 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.711s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ebdfd-2c4b-4bb6-88a8-4ff0d1b7902f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:37 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.862s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:25:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:25:37 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:25:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc Nov 06 21:25:37 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:38 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:38 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:38 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.390s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:25:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:25:45 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:INSERT=13,cinder:UPDATE=42,cinder:SELECT=29,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:46 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=35,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:48 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc" returned: 0 in 11.194s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:48 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d, size 1024.00 MB, duration 11.20 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:25:48 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Converted 1024.00 MB image at 91.47 MB/s Nov 06 21:25:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc is being set with open permissions: ugo+rw Nov 06 21:25:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:49 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc Nov 06 21:25:49 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:49 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc" returned: 0 in 0.390s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" released by "_copy_volume_from_snapshot" :: held 13.338s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165-17779a63-5661-4528-a14a-d9c953b302dc" released by "_create_volume_from_snapshot" :: held 13.424s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.453s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae52a7b-54b0-4d45-8c60-fd243f1e8938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17779a63-5661-4528-a14a-d9c953b302dc', 'volume_size': 1, 'snapshot_id': '15f36461-5339-4cd6-89e7-01a3c6233165'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd693a80-4cef-41f7-a268-ce99a442aec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Volume volume-17779a63-5661-4528-a14a-d9c953b302dc (17779a63-5661-4528-a14a-d9c953b302dc): created successfully Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd693a80-4cef-41f7-a268-ce99a442aec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Flow 'volume_create_manager' (0349fab3-001b-4ff8-9482-59d88d11c788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3ef29167-3284-402d-8b04-c27ac19863b3 tempest-VolumesDeleteCascade-1203075400 None] Created volume successfully. Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-bb26b1cb-2c90-4d49-acdf-d3900bb3411d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-bb26b1cb-2c90-4d49-acdf-d3900bb3411d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Performing cascade delete. {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1007}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-15f36461-5339-4cd6-89e7-01a3c6233165-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-15f36461-5339-4cd6-89e7-01a3c6233165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Deleting offline snapshot 15f36461-5339-4cd6-89e7-01a3c6233165 of volume bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] snapshot_file for this snap is: volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ce939b-f7ea-44c1-8be5-d8bb40963943]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:50 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:50 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:50 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.568s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d2447d-2b8f-44f4-8942-fa2ad50adddd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:51 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:51 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:51 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.645s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:51 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:51 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:52 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.412s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:52 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165 Nov 06 21:25:52 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:52 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d.15f36461-5339-4cd6-89e7-01a3c6233165" returned: 0 in 0.302s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-15f36461-5339-4cd6-89e7-01a3c6233165" released by "_delete_snapshot" :: held 2.064s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" released by "delete_snapshot" :: held 2.096s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['5c7c608d-2d68-47a6-9e20-36c38abaab5b', '2319c58d-d5fc-4543-b01f-117c4321270f', 'e37a0d09-c8b2-4406-b5ff-1cee8c7e75ca', 'd543d6b6-22e2-4a96-b3cf-163ca833dec5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Delete snapshot completed successfully. Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-15f36461-5339-4cd6-89e7-01a3c6233165-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Snapshots deleted, issuing volume delete {{(pid=87230) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1022}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ab753b-d8ca-463b-a9bc-42579857c7a8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:52 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:52 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:53 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.503s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:53 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d Nov 06 21:25:53 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:53 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-bb26b1cb-2c90-4d49-acdf-d3900bb3411d" released by "delete_volume" :: held 0.925s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['e1da484c-efb8-4af9-a144-3d735f0e55f7', 'bffacde2-5b6a-4296-86fd-48aac968c94a', '79adfd18-032b-48da-8606-0d958f52694f', '40697561-baa4-46e9-bc1b-a111976259a7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:53 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:53 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:54 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Deleted volume successfully. Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3c53e7d0-2c68-4807-9978-0d8c695f6d1e tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-bb26b1cb-2c90-4d49-acdf-d3900bb3411d-delete_volume" released by "delete_volume" :: held 3.985s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-17779a63-5661-4528-a14a-d9c953b302dc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-17779a63-5661-4528-a14a-d9c953b302dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d5813-0b97-4ed6-ba86-858ecce70c87]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:54 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc Nov 06 21:25:54 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:55 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc" returned: 0 in 0.431s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:55 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc Nov 06 21:25:55 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:55 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-17779a63-5661-4528-a14a-d9c953b302dc" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-quobyte-17779a63-5661-4528-a14a-d9c953b302dc" released by "delete_volume" :: held 0.808s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Created reservations ['eb63e18d-3d8a-466e-bc4a-e2686a38a99f', '6b515030-2273-4be5-8d8d-159cca886075', '79208ffc-2e41-462d-ae8d-208f7d7b1c98', '80eaed2d-8fc9-468c-ad83-ccf6ccca3e47'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Flow 'volume_create_manager' (c488e8b9-0723-4c7a-b34e-52129e094395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b609604b-9f1d-4b10-854f-2a08dec03d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b609604b-9f1d-4b10-854f-2a08dec03d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1439565463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b723a2ece1452f99c355e2ed6c9941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:56Z,use_quota=True,user_id='e1f4ce44560e45459f7aa6ac19ffb6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289263b0-bb1e-4cfd-a0f4-58111baa5e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289263b0-bb1e-4cfd-a0f4-58111baa5e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c146ae1-c068-429e-a16d-93e045dd7ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c146ae1-c068-429e-a16d-93e045dd7ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf', 'volume_name': 'volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d563c84-b42b-4afc-ae8a-6714fdbda4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d563c84-b42b-4afc-ae8a-6714fdbda4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37120f3-2a2b-4a2c-bbc8-026a943703a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Volume 21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf', 'volume_size': 1} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1439565463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b723a2ece1452f99c355e2ed6c9941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:56Z,use_quota=True,user_id='e1f4ce44560e45459f7aa6ac19ffb6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Creating volume 21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:55 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf 1073741824 Nov 06 21:25:55 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:55 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:25:55 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:56 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Deleted volume successfully. Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a71de857-984a-43df-ab6a-0c1e0b8a35c1 tempest-VolumesDeleteCascade-1203075400 None] Lock "cinder-17779a63-5661-4528-a14a-d9c953b302dc-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:56 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf 1073741824" returned: 0 in 0.600s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:56 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf Nov 06 21:25:56 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:56 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37120f3-2a2b-4a2c-bbc8-026a943703a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae8e795-e765-4438-ac6b-52c112ef0c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Volume volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf (21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf): created successfully Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae8e795-e765-4438-ac6b-52c112ef0c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Flow 'volume_create_manager' (c488e8b9-0723-4c7a-b34e-52129e094395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2cfe4fe7-9f98-45af-8247-515c2c40bc47 tempest-SnapshotMetadataTestJSON-1976756840 None] Created volume successfully. Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Creating offline snapshot 5162ff8d-15ed-41cb-8b47-c06cafedf703 of volume 21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6a60b5-4fcd-4a45-8472-06440d5b2c82]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:58 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf Nov 06 21:25:58 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:58 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" returned: 0 in 0.447s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:58 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 1G Nov 06 21:25:58 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 1G" returned: 0 in 0.641s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 Nov 06 21:25:59 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 is being set with open permissions: ugo+rw Nov 06 21:25:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 Nov 06 21:25:59 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:00 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:00 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info Nov 06 21:26:00 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:00 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:00 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info is being set with open permissions: ugo+rw Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:00 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info Nov 06 21:26:00 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:00 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.info" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-49c10159-71d6-4a23-ba26-147a2fa5bf57 tempest-SnapshotMetadataTestJSON-1976756840 None] Create snapshot completed successfully Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Flow 'volume_create_manager' (c9b9cc0b-8a80-4832-b3ce-9ee89f98fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67842e7e-b4fa-4067-b656-4ec11360636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67842e7e-b4fa-4067-b656-4ec11360636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1220516076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d3d671-4389-4e75-8a97-eac868824180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58c5e3935e3481d990b5ef90e111e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:01Z,use_quota=True,user_id='1075ca8b9636456082557a05a71cea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b3956e-df4c-4aa7-b85c-bd07694fd230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b3956e-df4c-4aa7-b85c-bd07694fd230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76903084-b0ed-4ff3-9760-2c3f6831d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76903084-b0ed-4ff3-9760-2c3f6831d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d3d671-4389-4e75-8a97-eac868824180', 'volume_name': 'volume-52d3d671-4389-4e75-8a97-eac868824180', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7f1d22-39b8-437c-a2b3-66a295e2134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7f1d22-39b8-437c-a2b3-66a295e2134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415f42a7-63e0-4f44-a668-534bf05e29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Volume 52d3d671-4389-4e75-8a97-eac868824180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d3d671-4389-4e75-8a97-eac868824180', 'volume_size': 1} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1220516076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d3d671-4389-4e75-8a97-eac868824180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58c5e3935e3481d990b5ef90e111e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:01Z,use_quota=True,user_id='1075ca8b9636456082557a05a71cea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Creating volume 52d3d671-4389-4e75-8a97-eac868824180 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:01 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 1073741824 Nov 06 21:26:01 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 1073741824" returned: 0 in 0.538s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:02 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 Nov 06 21:26:02 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "cinder-5162ff8d-15ed-41cb-8b47-c06cafedf703-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-5162ff8d-15ed-41cb-8b47-c06cafedf703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "cinder-quobyte-5162ff8d-15ed-41cb-8b47-c06cafedf703" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-5162ff8d-15ed-41cb-8b47-c06cafedf703" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Deleting offline snapshot 5162ff8d-15ed-41cb-8b47-c06cafedf703 of volume 21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] snapshot_file for this snap is: volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:26:02 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483a533-8694-4d9e-b6c2-5150ec3025e3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415f42a7-63e0-4f44-a668-534bf05e29eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d3d671-4389-4e75-8a97-eac868824180', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73a63bc-e2b0-4319-ab83-f71dfe1f9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Volume volume-52d3d671-4389-4e75-8a97-eac868824180 (52d3d671-4389-4e75-8a97-eac868824180): created successfully Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73a63bc-e2b0-4319-ab83-f71dfe1f9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Flow 'volume_create_manager' (c9b9cc0b-8a80-4832-b3ce-9ee89f98fa28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0ed697da-c731-4b2b-a0bc-7fe8f92edd79 tempest-VolumesMetadataTest-548059887 None] Created volume successfully. Nov 06 21:26:02 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 Nov 06 21:26:02 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703" returned: 0 in 0.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8088e8-1f32-4246-a875-b668e012891b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf Nov 06 21:26:03 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 Nov 06 21:26:03 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Flow 'volume_create_manager' (a0e677aa-6c2f-4c84-9124-424e7a74d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:03 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d96866e-c559-4971-b647-aa718b442fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703" returned: 0 in 0.593s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d96866e-c559-4971-b647-aa718b442fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150634587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b740f-5576-4f5c-8f50-59b5d66f69f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e551ddb5bf4043bcb799bf9a0e4816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:04Z,use_quota=True,user_id='26fa2b9015c040329f95d8e8ac35bce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0738f8f-86ba-44f9-8ed4-3fd539958f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:04 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703 Nov 06 21:26:04 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0738f8f-86ba-44f9-8ed4-3fd539958f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c300e061-8d99-4fbc-ba3a-ad4607582076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c300e061-8d99-4fbc-ba3a-ad4607582076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1b740f-5576-4f5c-8f50-59b5d66f69f5', 'volume_name': 'volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62c955a-0286-45ae-977d-244d74c88824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62c955a-0286-45ae-977d-244d74c88824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69082dc-b1a3-4d7f-bb9e-10f8e736301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Volume 7a1b740f-5576-4f5c-8f50-59b5d66f69f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5', 'volume_size': 1} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150634587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b740f-5576-4f5c-8f50-59b5d66f69f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e551ddb5bf4043bcb799bf9a0e4816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:04Z,use_quota=True,user_id='26fa2b9015c040329f95d8e8ac35bce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Creating volume 7a1b740f-5576-4f5c-8f50-59b5d66f69f5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 1073741824 Nov 06 21:26:04 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf.5162ff8d-15ed-41cb-8b47-c06cafedf703" returned: 0 in 0.546s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-5162ff8d-15ed-41cb-8b47-c06cafedf703" released by "_delete_snapshot" :: held 2.224s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" released by "delete_snapshot" :: held 2.253s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Created reservations ['e512d7b9-d7fa-4f63-9d1c-3ac7f1285298', 'caef2a7c-a80b-4b8c-8ce9-93de0c41b5f8', 'b23e7891-0eb3-43dc-b9d5-bcd26eec0fb1', 'b68ca522-70ff-4c9f-a9d2-0a99143e96de'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Acquiring lock "cinder-52d3d671-4389-4e75-8a97-eac868824180-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "cinder-52d3d671-4389-4e75-8a97-eac868824180-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Delete snapshot completed successfully. Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8ae5f2e2-fd59-4aa1-9dfd-85de4209ed8b tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-5162ff8d-15ed-41cb-8b47-c06cafedf703-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Acquiring lock "cinder-quobyte-52d3d671-4389-4e75-8a97-eac868824180" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "cinder-quobyte-52d3d671-4389-4e75-8a97-eac868824180" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:04 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 1073741824" returned: 0 in 0.864s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcaa38d-e954-4148-82e5-2a7b3e2d5f7f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 Nov 06 21:26:05 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 Nov 06 21:26:05 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" returned: 0 in 0.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69082dc-b1a3-4d7f-bb9e-10f8e736301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510c9c6d-710c-4e7c-addb-43bc699c4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Volume volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 (7a1b740f-5576-4f5c-8f50-59b5d66f69f5): created successfully Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510c9c6d-710c-4e7c-addb-43bc699c4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Flow 'volume_create_manager' (a0e677aa-6c2f-4c84-9124-424e7a74d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-152924a8-2676-4986-ab77-610fe368ff20 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Created volume successfully. Nov 06 21:26:05 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180 Nov 06 21:26:05 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "cinder-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52d3d671-4389-4e75-8a97-eac868824180" returned: 0 in 0.328s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "cinder-quobyte-52d3d671-4389-4e75-8a97-eac868824180" released by "delete_volume" :: held 0.815s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d5870-9cf0-4d47-bc0c-cfabe702a4ac]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Created reservations ['442427d0-56ce-4e69-80fe-2c2ece8c0046', '537002dc-130c-429e-9615-8eaf608c5e62', 'c563ae01-da62-4cbf-9a72-d247390e8949', '0684e4b5-5fa4-499a-b5ce-a31e66201aed'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:05 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:06 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" returned: 0 in 0.528s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf Nov 06 21:26:06 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.550s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Deleted volume successfully. Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-eca9ff97-9e7c-475e-b385-40b564b2384c tempest-VolumesMetadataTest-548059887 None] Lock "cinder-52d3d671-4389-4e75-8a97-eac868824180-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:06 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-quobyte-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf" released by "delete_volume" :: held 1.093s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Created reservations ['b45cb02c-ee91-4143-8482-2707d8dbbf4b', 'e0ae7213-4d2b-4da7-8710-beed7be1baae', '5bd9a080-6f1f-45db-8639-ae4a2af5741c', '90c59461-82cd-464b-9311-e65a01a1f864'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:07 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:07 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-75917e31-5fd4-4feb-9f4a-f8606893e37b req-3c026e08-6d5a-4f26-9931-9339f7fc7551 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-75917e31-5fd4-4feb-9f4a-f8606893e37b req-3c026e08-6d5a-4f26-9931-9339f7fc7551 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-75917e31-5fd4-4feb-9f4a-f8606893e37b req-3c026e08-6d5a-4f26-9931-9339f7fc7551 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-75917e31-5fd4-4feb-9f4a-f8606893e37b req-3c026e08-6d5a-4f26-9931-9339f7fc7551 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4bb5d90-19f3-440b-8103-acd7abc02c79', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:26:07 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.331s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Deleted volume successfully. Nov 06 21:26:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-75917e31-5fd4-4feb-9f4a-f8606893e37b req-3c026e08-6d5a-4f26-9931-9339f7fc7551 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] attachment_update completed successfully. Nov 06 21:26:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fffdf425-cb3e-4cac-ad7e-9c14bbacccb8 tempest-SnapshotMetadataTestJSON-1976756840 None] Lock "cinder-21ab3b5a-b2ff-4cc1-9e15-e0da04078dbf-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-ac10f54a-f6ed-4760-b0b4-b2123212c5bf req-c64d4e60-c441-438e-8182-48fe76bb8705 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Terminate volume connection completed successfully. Nov 06 21:26:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-ac10f54a-f6ed-4760-b0b4-b2123212c5bf req-c64d4e60-c441-438e-8182-48fe76bb8705 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Deleting attachment c4bb5d90-19f3-440b-8103-acd7abc02c79. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:26:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "cinder-7a1b740f-5576-4f5c-8f50-59b5d66f69f5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "cinder-7a1b740f-5576-4f5c-8f50-59b5d66f69f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "cinder-quobyte-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "cinder-quobyte-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6fbf57-b10a-46c8-b851-617042c89e33]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:13 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 Nov 06 21:26:13 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:13 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:13 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5 Nov 06 21:26:13 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:13 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" returned: 0 in 0.387s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "cinder-quobyte-7a1b740f-5576-4f5c-8f50-59b5d66f69f5" released by "delete_volume" :: held 0.934s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Created reservations ['8d64b21f-3da0-43ef-b89f-78fea032a6c2', 'dee28dbc-806a-4a40-ad37-50c21491803c', 'e2968b67-f70f-41c8-9b23-dd7e5b68dedd', '6c7f5d51-2db5-48d0-b9b6-f18a64d32eb3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:14 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:14 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:14 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.312s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Deleted volume successfully. Nov 06 21:26:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-4cf1b6af-75b4-4c14-a61f-2aed232a3911 tempest-TestServerVolumeAttachScenarioOldVersion-44855266 None] Lock "cinder-7a1b740f-5576-4f5c-8f50-59b5d66f69f5-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Flow 'volume_create_manager' (a1c7d48c-9ef3-45b1-9a9c-48c238e4258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bc8101-0026-40b3-946e-b5b9d9f343de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bc8101-0026-40b3-946e-b5b9d9f343de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1465507310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8773f47-a83d-453d-a5f3-fbcdb67fee59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651848a4135343e19409ea1174e706e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:15Z,use_quota=True,user_id='e68048514f324565bb30065c5bc62aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed6fc07-ef1a-4515-bd9d-bfc3f32ed766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed6fc07-ef1a-4515-bd9d-bfc3f32ed766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc891c5-0fb1-4716-8da0-93adb1e0dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc891c5-0fb1-4716-8da0-93adb1e0dae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8773f47-a83d-453d-a5f3-fbcdb67fee59', 'volume_name': 'volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbaabf-63a3-4558-ba87-fe6229c443b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbaabf-63a3-4558-ba87-fe6229c443b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e67f5-f7ef-41f4-8ad0-84e8ffde8a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Volume b8773f47-a83d-453d-a5f3-fbcdb67fee59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59', 'volume_size': 1} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1465507310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8773f47-a83d-453d-a5f3-fbcdb67fee59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651848a4135343e19409ea1174e706e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:15Z,use_quota=True,user_id='e68048514f324565bb30065c5bc62aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Creating volume b8773f47-a83d-453d-a5f3-fbcdb67fee59 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:15 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 1073741824 Nov 06 21:26:15 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:16 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 1073741824" returned: 0 in 0.818s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:16 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 Nov 06 21:26:16 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:16 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59" returned: 0 in 0.541s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e67f5-f7ef-41f4-8ad0-84e8ffde8a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a4b55-e908-4a58-b824-299658aa0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Volume volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 (b8773f47-a83d-453d-a5f3-fbcdb67fee59): created successfully Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a4b55-e908-4a58-b824-299658aa0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Flow 'volume_create_manager' (a1c7d48c-9ef3-45b1-9a9c-48c238e4258c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a7416c7e-9a19-4dce-b512-81e1db26bb59 tempest-VolumesTransfersV357Test-359874018 None] Created volume successfully. Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Flow 'volume_create_manager' (002abb1d-b3ab-44ae-9385-983da603c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68810c9f-7850-4f78-98b2-fb162353b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68810c9f-7850-4f78-98b2-fb162353b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1815149126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96ec3cb-25d4-41aa-91e8-4e102b88bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce7176d813a413db5f3fa5ab46b4357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='cf90b32592aa43b5bd97c875aacc1857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bb1daf-72dc-4b89-bae2-4072682d4d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bb1daf-72dc-4b89-bae2-4072682d4d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b5c79-b78e-4991-b952-80935ae433f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6b5c79-b78e-4991-b952-80935ae433f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96ec3cb-25d4-41aa-91e8-4e102b88bc7c', 'volume_name': 'volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55286fa6-267b-40c8-a574-c13d3a82707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55286fa6-267b-40c8-a574-c13d3a82707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1323d6-79b0-4581-ae7f-ef81c84b7023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Volume c96ec3cb-25d4-41aa-91e8-4e102b88bc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c', 'volume_size': 1} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1815149126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96ec3cb-25d4-41aa-91e8-4e102b88bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce7176d813a413db5f3fa5ab46b4357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='cf90b32592aa43b5bd97c875aacc1857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Creating volume c96ec3cb-25d4-41aa-91e8-4e102b88bc7c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:18 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c 1073741824 Nov 06 21:26:18 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a4936a0e-0453-4d20-9fb6-d60079d4600d tempest-VolumesTransfersV357Test-345405330 None] Transfer volume completed successfully. Nov 06 21:26:19 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c 1073741824" returned: 0 in 0.726s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:19 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c Nov 06 21:26:19 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "cinder-b8773f47-a83d-453d-a5f3-fbcdb67fee59-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-b8773f47-a83d-453d-a5f3-fbcdb67fee59-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "cinder-quobyte-b8773f47-a83d-453d-a5f3-fbcdb67fee59" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-quobyte-b8773f47-a83d-453d-a5f3-fbcdb67fee59" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038a297-a397-4168-8ded-d044d41d34eb]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:19 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1323d6-79b0-4581-ae7f-ef81c84b7023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcfb37e-9652-4d03-850c-87edf2e15f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 Nov 06 21:26:19 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Volume volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c (c96ec3cb-25d4-41aa-91e8-4e102b88bc7c): created successfully Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcfb37e-9652-4d03-850c-87edf2e15f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Flow 'volume_create_manager' (002abb1d-b3ab-44ae-9385-983da603c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-48142a67-401e-4543-931c-3e5d74bcc248 tempest-VolumesTransfersV355Test-1773189101 None] Created volume successfully. Nov 06 21:26:20 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59" returned: 0 in 0.497s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:20 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59 Nov 06 21:26:20 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:20 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b8773f47-a83d-453d-a5f3-fbcdb67fee59" returned: 0 in 0.281s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-quobyte-b8773f47-a83d-453d-a5f3-fbcdb67fee59" released by "delete_volume" :: held 0.855s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Created reservations ['55fee857-0f17-41cc-aad7-1c38eecc949f', 'ce60f58f-5c83-4be5-aab3-a46b098e72d5', '1eebb840-c75f-44ff-97d0-2d1ac8a42bf3', '04f2c956-9eb8-40e3-a7e6-972ae31d36fe'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:20 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:20 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:21 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.311s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Deleted volume successfully. Nov 06 21:26:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34ccf35b-f817-4ee5-a255-279f3c844e18 tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-b8773f47-a83d-453d-a5f3-fbcdb67fee59-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-857f7a8c-b570-493a-ba48-10caea896dbe tempest-VolumesTransfersV355Test-874944617 None] Transfer volume completed successfully. Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "cinder-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "cinder-quobyte-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-quobyte-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7bd60-98a5-44ca-a968-ee78c6e023bd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:22 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c Nov 06 21:26:22 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Flow 'volume_create_manager' (9aa8e742-652a-4d5f-b6ad-2cc91e1f0caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ecd1f6-44e6-46f6-983e-3d91600bcbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ecd1f6-44e6-46f6-983e-3d91600bcbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-939549641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836309ad-6bac-41aa-890b-3386d0a69d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651848a4135343e19409ea1174e706e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:22Z,use_quota=True,user_id='e68048514f324565bb30065c5bc62aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77f2af3-a51d-46ab-a669-db26d62727e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77f2af3-a51d-46ab-a669-db26d62727e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53123de7-7ffd-4363-9417-76c014004973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53123de7-7ffd-4363-9417-76c014004973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836309ad-6bac-41aa-890b-3386d0a69d70', 'volume_name': 'volume-836309ad-6bac-41aa-890b-3386d0a69d70', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb32e9e1-e2ab-4cae-a567-9cf25187afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb32e9e1-e2ab-4cae-a567-9cf25187afc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca3c4c3-09ff-4f8f-b488-d1a823fcd6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Volume 836309ad-6bac-41aa-890b-3386d0a69d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836309ad-6bac-41aa-890b-3386d0a69d70', 'volume_size': 1} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-939549641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836309ad-6bac-41aa-890b-3386d0a69d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651848a4135343e19409ea1174e706e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:22Z,use_quota=True,user_id='e68048514f324565bb30065c5bc62aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Creating volume 836309ad-6bac-41aa-890b-3386d0a69d70 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:22 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 1073741824 Nov 06 21:26:22 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" returned: 0 in 0.585s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c Nov 06 21:26:23 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-quobyte-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c" released by "delete_volume" :: held 1.020s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 1073741824" returned: 0 in 0.719s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 Nov 06 21:26:23 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Created reservations ['3da82259-e1f9-4e91-9c8a-b7b1deb7d453', '262ba7b3-e2fe-4ac7-b07a-be5c904f8ce7', 'e22d9c45-fb1a-49d9-9635-7f0d53190ce8', 'ab71fe6b-de4e-4083-aeca-2ae319519b9b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:23 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70" returned: 0 in 0.403s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca3c4c3-09ff-4f8f-b488-d1a823fcd6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836309ad-6bac-41aa-890b-3386d0a69d70', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e327746a-249d-43ef-adbb-81493baca8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.334s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Volume volume-836309ad-6bac-41aa-890b-3386d0a69d70 (836309ad-6bac-41aa-890b-3386d0a69d70): created successfully Nov 06 21:26:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e327746a-249d-43ef-adbb-81493baca8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Flow 'volume_create_manager' (9aa8e742-652a-4d5f-b6ad-2cc91e1f0caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Deleted volume successfully. Nov 06 21:26:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2258707b-577f-4073-9983-e19195ff8c00 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-c96ec3cb-25d4-41aa-91e8-4e102b88bc7c-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e439eeae-e71e-4075-ab94-93a4a12dba8c tempest-VolumesTransfersV357Test-359874018 None] Created volume successfully. Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "cinder-836309ad-6bac-41aa-890b-3386d0a69d70-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-836309ad-6bac-41aa-890b-3386d0a69d70-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "cinder-quobyte-836309ad-6bac-41aa-890b-3386d0a69d70" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-quobyte-836309ad-6bac-41aa-890b-3386d0a69d70" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a1f420-5873-43e1-8b2f-e69bfecd41b0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 Nov 06 21:26:25 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Flow 'volume_create_manager' (c2f5c16e-8a93-443e-90f2-8ed33be0f56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359fb9a6-472d-4a1d-b723-0f8b2ada3157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359fb9a6-472d-4a1d-b723-0f8b2ada3157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-526414042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f177318f-a277-45b8-9b20-08cb2cd84d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce7176d813a413db5f3fa5ab46b4357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:25Z,use_quota=True,user_id='cf90b32592aa43b5bd97c875aacc1857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a30dd6-23fa-4a43-9558-ff8acf67a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a30dd6-23fa-4a43-9558-ff8acf67a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6f5e98-33c9-4488-a935-b0d4bd6d3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6f5e98-33c9-4488-a935-b0d4bd6d3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f177318f-a277-45b8-9b20-08cb2cd84d54', 'volume_name': 'volume-f177318f-a277-45b8-9b20-08cb2cd84d54', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35b4b04-7c60-46f9-a8a1-e1fa919db797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35b4b04-7c60-46f9-a8a1-e1fa919db797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d29ee-7d2b-4cd0-9d45-c39ca207cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Volume f177318f-a277-45b8-9b20-08cb2cd84d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f177318f-a277-45b8-9b20-08cb2cd84d54', 'volume_size': 1} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-526414042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f177318f-a277-45b8-9b20-08cb2cd84d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce7176d813a413db5f3fa5ab46b4357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:25Z,use_quota=True,user_id='cf90b32592aa43b5bd97c875aacc1857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Creating volume f177318f-a277-45b8-9b20-08cb2cd84d54 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 1073741824 Nov 06 21:26:25 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:25 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70" returned: 0 in 0.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70 Nov 06 21:26:25 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-836309ad-6bac-41aa-890b-3386d0a69d70" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-quobyte-836309ad-6bac-41aa-890b-3386d0a69d70" released by "delete_volume" :: held 0.956s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:26 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 1073741824" returned: 0 in 0.644s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Created reservations ['fb743b89-7a82-424f-b576-83cb5911ab22', '9deedd00-e995-4f3b-9f09-9ba3df2c83c0', '41a57bc6-7f66-4688-ac73-650004c6bc2e', '64184665-2b59-498c-be7e-81be054fe44c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 Nov 06 21:26:26 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:26 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54" returned: 0 in 0.389s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d29ee-7d2b-4cd0-9d45-c39ca207cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f177318f-a277-45b8-9b20-08cb2cd84d54', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7af1ee-805c-4a6c-8964-1f7a9d421987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Volume volume-f177318f-a277-45b8-9b20-08cb2cd84d54 (f177318f-a277-45b8-9b20-08cb2cd84d54): created successfully Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7af1ee-805c-4a6c-8964-1f7a9d421987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Flow 'volume_create_manager' (c2f5c16e-8a93-443e-90f2-8ed33be0f56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b0301c55-d950-4e4f-bdbb-61a89ec86d1d tempest-VolumesTransfersV355Test-1773189101 None] Created volume successfully. Nov 06 21:26:26 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.410s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Deleted volume successfully. Nov 06 21:26:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-69461ffd-759f-464c-ac28-a5654654804a tempest-VolumesTransfersV357Test-869769356 None] Lock "cinder-836309ad-6bac-41aa-890b-3386d0a69d70-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "cinder-f177318f-a277-45b8-9b20-08cb2cd84d54-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-f177318f-a277-45b8-9b20-08cb2cd84d54-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "cinder-quobyte-f177318f-a277-45b8-9b20-08cb2cd84d54" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-quobyte-f177318f-a277-45b8-9b20-08cb2cd84d54" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c2c74-dc3c-488d-a798-ab1118326ee6]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 Nov 06 21:26:28 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54 Nov 06 21:26:28 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Flow 'volume_create_manager' (4902ce92-beeb-439e-a8b6-d9865c64b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a031156-78c8-48bc-bf05-be7d9f52726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a031156-78c8-48bc-bf05-be7d9f52726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-557974655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815ef598-cc71-4e0c-85a4-7fa35595c7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8820a2b7f4ababca0851b00c73661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:29Z,use_quota=True,user_id='8197f6e9480d4e10bd89187558f18481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f7d06-80a1-4404-8b88-0badca809868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f7d06-80a1-4404-8b88-0badca809868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ed39a-944f-4bb9-969f-e7a2ab84b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ed39a-944f-4bb9-969f-e7a2ab84b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '815ef598-cc71-4e0c-85a4-7fa35595c7d1', 'volume_name': 'volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54f36c-e147-4c73-b7ec-b9ab8fc9859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54f36c-e147-4c73-b7ec-b9ab8fc9859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be64e580-bfba-468d-a66f-2af838a6c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Volume 815ef598-cc71-4e0c-85a4-7fa35595c7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1', 'volume_size': 1} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-557974655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815ef598-cc71-4e0c-85a4-7fa35595c7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8820a2b7f4ababca0851b00c73661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:29Z,use_quota=True,user_id='8197f6e9480d4e10bd89187558f18481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Creating volume 815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:28 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:26:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 1073741824 Nov 06 21:26:28 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:29 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f177318f-a277-45b8-9b20-08cb2cd84d54" returned: 0 in 0.364s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-quobyte-f177318f-a277-45b8-9b20-08cb2cd84d54" released by "delete_volume" :: held 0.918s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Created reservations ['6536c3bc-f3a0-4192-8421-383602e7a000', 'cff2677a-09d4-4c0d-8e51-8bb3464b974e', '7287a90f-19b9-417d-8865-8a483da1fb12', '68c9d69b-95f5-4a73-ad67-266054f0103b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:29 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:29 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:29 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.428s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Deleted volume successfully. Nov 06 21:26:29 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 1073741824" returned: 0 in 0.820s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cf5381e-556d-495b-bf25-5114b69b94f0 tempest-VolumesTransfersV355Test-845251865 None] Lock "cinder-f177318f-a277-45b8-9b20-08cb2cd84d54-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:29 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:26:29 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:30 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be64e580-bfba-468d-a66f-2af838a6c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd68577-554f-4ee1-a1fd-e2a13fc8829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Volume volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 (815ef598-cc71-4e0c-85a4-7fa35595c7d1): created successfully Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd68577-554f-4ee1-a1fd-e2a13fc8829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Flow 'volume_create_manager' (4902ce92-beeb-439e-a8b6-d9865c64b135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-501c5314-1c76-4cae-b52b-70d3de496d75 tempest-TestImageHashVerification-1901849834 None] Created volume successfully. Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b5f17-17a3-4d53-86e5-d83f733be3ab]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:32 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:26:32 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:32 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.543s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f2b2f9-db2d-465a-8671-070ce89c8041]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:33 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:26:33 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:33 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.497s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 /opt/stack/data/cinder/conversion/815ef598-cc71-4e0c-85a4-7fa35595c7d1.temp_image.1981833a-2726-4381-8874-383b4a7e258f3z4gcg5t.img {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:33 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 /opt/stack/data/cinder/conversion/815ef598-cc71-4e0c-85a4-7fa35595c7d1.temp_image.1981833a-2726-4381-8874-383b4a7e258f3z4gcg5t.img Nov 06 21:26:33 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:38 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:26:38 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:38 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.684s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:26:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:26:40 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=122,cinder:SELECT=84,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (73ab3f34-4601-4a1b-a58e-a4f84670bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e27a88-fc28-4139-8a9b-a5fbd6262fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e27a88-fc28-4139-8a9b-a5fbd6262fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-122975548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab86b7bb-8a6b-45f9-85de-725b70d9d5b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:41Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df3af65-4b4e-479a-8fa2-b2e910b411d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df3af65-4b4e-479a-8fa2-b2e910b411d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5457b0-bc6d-4166-8290-e43bc35e2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5457b0-bc6d-4166-8290-e43bc35e2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab86b7bb-8a6b-45f9-85de-725b70d9d5b8', 'volume_name': 'volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071461ce-df31-469f-8005-ca0bce8ac240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071461ce-df31-469f-8005-ca0bce8ac240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ee5c71-e25c-4032-a592-eab06f2c6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Volume ab86b7bb-8a6b-45f9-85de-725b70d9d5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8', 'volume_size': 1} Nov 06 21:26:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:42 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 /opt/stack/data/cinder/conversion/815ef598-cc71-4e0c-85a4-7fa35595c7d1.temp_image.1981833a-2726-4381-8874-383b4a7e258f3z4gcg5t.img" returned: 0 in 9.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b69a4-9436-4816-ba6a-b4c0c299dbfc]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:42 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:26:42 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.608s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:43 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1, size 1024.00 MB, duration 9.36 sec, destination /opt/stack/data/cinder/conversion/815ef598-cc71-4e0c-85a4-7fa35595c7d1.temp_image.1981833a-2726-4381-8874-383b4a7e258f3z4gcg5t.img {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:26:43 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Converted 1024.00 MB image at 109.36 MB/s Nov 06 21:26:43 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] 1981833a-2726-4381-8874-383b4a7e258f was raw, no need to convert to raw {{(pid=87230) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=90,cinder:INSERT=25,cinder:UPDATE=104,cinder:DELETE=13 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Flow 'volume_create_manager' (8eea4b5b-5623-4a44-a80b-0f0cf4a70351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3914692d-e355-4d18-85fb-068726e786af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3914692d-e355-4d18-85fb-068726e786af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1402211102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779f10ea-5d60-48d7-bfb9-e7015503d8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17985eb2ab234177ad1f640d7dbc4e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:49Z,use_quota=True,user_id='3cdc7c4dca264504b9ee0c065c8a461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae0d706-4f70-4a52-87e5-c93140e85159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae0d706-4f70-4a52-87e5-c93140e85159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2241b47-1ef0-4fc7-8ff8-bb3681841881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Flow 'volume_create_manager' (7ead9c64-ac16-4553-a3b0-6d5ec563e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01f016f-b118-401d-bd2f-72b9a3cf1091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01f016f-b118-401d-bd2f-72b9a3cf1091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d17964-25af-4a10-9521-99e012ffa0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e776378b5704400885821849e3f8c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:49Z,use_quota=True,user_id='b879cf65e6ea4304a0be634c4ea9ebfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537fa07b-104e-4901-b9d4-7743081af2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537fa07b-104e-4901-b9d4-7743081af2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a02b2d0-f596-4ac6-9d29-237dd19d8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2241b47-1ef0-4fc7-8ff8-bb3681841881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '779f10ea-5d60-48d7-bfb9-e7015503d8f3', 'volume_name': 'volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93330a1e-49c5-4f54-8231-49b792f90dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93330a1e-49c5-4f54-8231-49b792f90dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2e4be2-9aff-47ff-9332-65c82e2fd0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Trying to clone 779f10ea-5d60-48d7-bfb9-e7015503d8f3 from image 007d3188-64b0-400e-a10b-94dd7e89a175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a02b2d0-f596-4ac6-9d29-237dd19d8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4d17964-25af-4a10-9521-99e012ffa0b8', 'volume_name': 'volume-c4d17964-25af-4a10-9521-99e012ffa0b8', 'volume_size': 1, 'image_id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6182426732b6c09f93091cd0fc78d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e776378b5704400885821849e3f8c2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51927432792c2cc10890af4d0941ccceb48c131b27ba07a5951cba289d8ab3331ca2da121b3775573503e87ecd2caef41da570c56cc8d133a0bd78be4733d0e1', 'id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae99ee-631c-43de-8d9f-02720ecdf131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae99ee-631c-43de-8d9f-02720ecdf131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3863b-4f24-4945-8016-0c8c8d7c808e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Volume c4d17964-25af-4a10-9521-99e012ffa0b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4d17964-25af-4a10-9521-99e012ffa0b8', 'volume_size': 1, 'image_id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6182426732b6c09f93091cd0fc78d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e776378b5704400885821849e3f8c2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51927432792c2cc10890af4d0941ccceb48c131b27ba07a5951cba289d8ab3331ca2da121b3775573503e87ecd2caef41da570c56cc8d133a0bd78be4733d0e1', 'id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6/file', 'properties': {}}, 'image_service': } Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Trying to clone c4d17964-25af-4a10-9521-99e012ffa0b8 from image aa3da16a-089a-47d4-9e58-2e539a3f38a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:26:49 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:26:49 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e97ab5-5b93-4ba6-b4c0-32c1976b50a2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03dc37-47b5-46db-bad4-e9fdbb10f0da]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:49 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:26:49 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD Nov 06 21:26:50 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:50 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 is fetched for user 3cdc7c4dca264504b9ee0c065c8a461c. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:26:50 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:26:50 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b162db-0b8b-4a26-8f24-f55b6be90db1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:50 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD Nov 06 21:26:50 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:50 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 1 in 0.505s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Temporary image aa3da16a-089a-47d4-9e58-2e539a3f38a6 is fetched for user b879cf65e6ea4304a0be634c4ea9ebfa. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:26:50 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac5851e-dee2-4c46-a1c6-acf430eded13]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:51 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:26:51 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:51 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:51 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:26:51 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:51 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:26:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:00 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:INSERT=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.241s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Uploaded volume to glance image-id: 1981833a-2726-4381-8874-383b4a7e258f. {{(pid=87230) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.101s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-122975548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab86b7bb-8a6b-45f9-85de-725b70d9d5b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:41Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Creating volume ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:03 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 1073741824 Nov 06 21:27:03 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8d5845a9-74c4-42bb-964f-3ea180e5a316 tempest-TestImageHashVerification-1901849834 None] Copy volume to image completed successfully. Nov 06 21:27:04 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 1073741824" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 Nov 06 21:27:04 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:04 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" returned: 0 in 0.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.528s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1402211102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779f10ea-5d60-48d7-bfb9-e7015503d8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17985eb2ab234177ad1f640d7dbc4e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:49Z,use_quota=True,user_id='3cdc7c4dca264504b9ee0c065c8a461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Creating volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ee5c71-e25c-4032-a592-eab06f2c6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecaa362-ab55-4611-b3ad-1accb8dac263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:04 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1073741824 Nov 06 21:27:04 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Volume volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 (ab86b7bb-8a6b-45f9-85de-725b70d9d5b8): created successfully Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecaa362-ab55-4611-b3ad-1accb8dac263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (73ab3f34-4601-4a1b-a58e-a4f84670bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b46dc1ae-639e-4a1d-9b1b-d587127ad502 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "cinder-815ef598-cc71-4e0c-85a4-7fa35595c7d1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "cinder-815ef598-cc71-4e0c-85a4-7fa35595c7d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "cinder-quobyte-815ef598-cc71-4e0c-85a4-7fa35595c7d1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "cinder-quobyte-815ef598-cc71-4e0c-85a4-7fa35595c7d1" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70fd7c6-4b93-4981-95fc-0eb260628cd1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1073741824" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 Nov 06 21:27:05 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:27:05 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.657s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d17964-25af-4a10-9521-99e012ffa0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e776378b5704400885821849e3f8c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:49Z,use_quota=True,user_id='b879cf65e6ea4304a0be634c4ea9ebfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Creating volume c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:05 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1073741824 Nov 06 21:27:05 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Attempting download of 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:05 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1 Nov 06 21:27:05 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3324f08b-efa5-4467-9808-71f34a86120f]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t Nov 06 21:27:05 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (2fe01df9-c895-44f6-b918-b5dee25bcddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811af23f-8fc1-4f5c-9658-f6e6b45d7938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811af23f-8fc1-4f5c-9658-f6e6b45d7938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001481573',display_name='tempest-VolumesGetTest-Volume-1199296066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376933fd-2bc4-421d-8340-e0a7d9a7c50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:06Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f64e83-63d1-4c9b-889a-164399d579d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f64e83-63d1-4c9b-889a-164399d579d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3cb3ec-3a67-494c-89fe-b88f344b3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3cb3ec-3a67-494c-89fe-b88f344b3c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376933fd-2bc4-421d-8340-e0a7d9a7c50f', 'volume_name': 'volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4161a4d8-e39a-439c-8654-b583b2fc4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4161a4d8-e39a-439c-8654-b583b2fc4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c454e36-6fc4-4776-9228-ab4a2df7a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Volume 376933fd-2bc4-421d-8340-e0a7d9a7c50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f', 'volume_size': 1} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:05 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-815ef598-cc71-4e0c-85a4-7fa35595c7d1" returned: 0 in 0.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "cinder-quobyte-815ef598-cc71-4e0c-85a4-7fa35595c7d1" released by "delete_volume" :: held 0.986s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:05 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1073741824" returned: 0 in 0.614s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t Nov 06 21:27:06 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Created reservations ['c2df44bd-cfe4-47df-ae6b-8bc195ad0cc3', '2d81dde5-9dc2-47f2-86ac-a48eebb21a9c', 'bcb567ed-5a95-4533-bf8a-1e3fd8335ffd', 'd6e9f013-6b38-48fe-a272-30530c3f3c0e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:06 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 Nov 06 21:27:06 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:06 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t" returned: 1 in 0.357s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_ibao6__t' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acec0c-d787-4cc7-b8bc-2945d4d90e58]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001481573',display_name='tempest-VolumesGetTest-Volume-1199296066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376933fd-2bc4-421d-8340-e0a7d9a7c50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:06Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Creating volume 376933fd-2bc4-421d-8340-e0a7d9a7c50f {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:06 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f 1073741824 Nov 06 21:27:06 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Attempting download of aa3da16a-089a-47d4-9e58-2e539a3f38a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}])) to volume c4d17964-25af-4a10-9521-99e012ffa0b8. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:06 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Deleted volume successfully. Nov 06 21:27:06 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD Nov 06 21:27:06 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[974da9ab-f194-4c92-bc4d-9f910ed2976f]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-efe3cee4-8f74-4ea2-a9fe-02febca64081 tempest-TestImageHashVerification-1901849834 None] Lock "cinder-815ef598-cc71-4e0c-85a4-7fa35595c7d1-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:06 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt Nov 06 21:27:06 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] 007d3188-64b0-400e-a10b-94dd7e89a175 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 Nov 06 21:27:06 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f 1073741824" returned: 0 in 0.562s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f Nov 06 21:27:06 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt Nov 06 21:27:07 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt" returned: 1 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa3da16a-089a-47d4-9e58-2e539a3f38a6_rf1piytt' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671c930-ef4b-4476-8bb8-be3037749590]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:07 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f" returned: 0 in 0.338s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c454e36-6fc4-4776-9228-ab4a2df7a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895d5f97-bca0-45c3-8303-a895ced1b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Volume volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f (376933fd-2bc4-421d-8340-e0a7d9a7c50f): created successfully Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895d5f97-bca0-45c3-8303-a895ced1b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (2fe01df9-c895-44f6-b918-b5dee25bcddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0f550bb1-110b-41a7-b115-aa9dd5c18c74 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:07 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:27:07 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:07 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD Nov 06 21:27:07 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-376933fd-2bc4-421d-8340-e0a7d9a7c50f-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] aa3da16a-089a-47d4-9e58-2e539a3f38a6 was raw, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "cinder-376933fd-2bc4-421d-8340-e0a7d9a7c50f-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 Nov 06 21:27:08 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-376933fd-2bc4-421d-8340-e0a7d9a7c50f" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-376933fd-2bc4-421d-8340-e0a7d9a7c50f" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfcf72-d233-47bd-913f-e3db047c5be4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f Nov 06 21:27:08 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8" returned: 0 in 0.587s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa3da16a-089a-47d4-9e58-2e539a3f38a6_8rap6mk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:08 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1G Nov 06 21:27:08 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f" returned: 0 in 0.465s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:08 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f Nov 06 21:27:08 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:09 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3" returned: 0 in 2.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_5kccwffvdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Converted 112.00 MB image at 46.31 MB/s Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1G Nov 06 21:27:09 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:09 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-376933fd-2bc4-421d-8340-e0a7d9a7c50f" returned: 0 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 1G" returned: 0 in 0.484s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Downloaded image aa3da16a-089a-47d4-9e58-2e539a3f38a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}])) to volume c4d17964-25af-4a10-9521-99e012ffa0b8 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Temporary image aa3da16a-089a-47d4-9e58-2e539a3f38a6 for user b879cf65e6ea4304a0be634c4ea9ebfa is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Marking volume c4d17964-25af-4a10-9521-99e012ffa0b8 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-376933fd-2bc4-421d-8340-e0a7d9a7c50f" released by "delete_volume" :: held 0.903s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Copying metadata from image aa3da16a-089a-47d4-9e58-2e539a3f38a6 to c4d17964-25af-4a10-9521-99e012ffa0b8. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Creating volume glance metadata for volume c4d17964-25af-4a10-9521-99e012ffa0b8 backed by image aa3da16a-089a-47d4-9e58-2e539a3f38a6 with: {'image_id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b6182426732b6c09f93091cd0fc78d1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Created reservations ['c3b7a27d-ea53-48be-890a-395e68db9c64', '3e24e760-ae65-4708-aa7a-755b653693a5', 'e427c351-bf1f-4511-af9b-0bde01c3237f', '334a86cc-741c-4036-86af-eae76a37f18d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3863b-4f24-4945-8016-0c8c8d7c808e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d17964-25af-4a10-9521-99e012ffa0b8', 'volume_size': 1, 'image_id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6182426732b6c09f93091cd0fc78d1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e776378b5704400885821849e3f8c2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51927432792c2cc10890af4d0941ccceb48c131b27ba07a5951cba289d8ab3331ca2da121b3775573503e87ecd2caef41da570c56cc8d133a0bd78be4733d0e1', 'id': 'aa3da16a-089a-47d4-9e58-2e539a3f38a6', 'created_at': datetime.datetime(2026, 11, 6, 20, 26, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa3da16a-089a-47d4-9e58-2e539a3f38a6/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28310b2-d7d3-41c8-b6c7-d968cc80a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Volume volume-c4d17964-25af-4a10-9521-99e012ffa0b8 (c4d17964-25af-4a10-9521-99e012ffa0b8): created successfully Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28310b2-d7d3-41c8-b6c7-d968cc80a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Flow 'volume_create_manager' (7ead9c64-ac16-4553-a3b0-6d5ec563e55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-74e2b25a-1598-4bdd-ae8c-a1d699c15159 tempest-VolumeImageDependencyTests-879373418 None] Created volume successfully. Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:09 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:09 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 1G" returned: 0 in 0.447s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Downloaded image 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 for user 3cdc7c4dca264504b9ee0c065c8a461c is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Marking volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Copying metadata from image 007d3188-64b0-400e-a10b-94dd7e89a175 to 779f10ea-5d60-48d7-bfb9-e7015503d8f3. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Creating volume glance metadata for volume 779f10ea-5d60-48d7-bfb9-e7015503d8f3 backed by image 007d3188-64b0-400e-a10b-94dd7e89a175 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2e4be2-9aff-47ff-9332-65c82e2fd0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64e82ef-360c-45b3-af00-eedf494d6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Volume volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 (779f10ea-5d60-48d7-bfb9-e7015503d8f3): created successfully Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64e82ef-360c-45b3-af00-eedf494d6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Flow 'volume_create_manager' (8eea4b5b-5623-4a44-a80b-0f0cf4a70351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4e07637f-b4c2-49d4-ab15-eed39f6623b1 tempest-VolumesExtendTest-1390046812 None] Created volume successfully. Nov 06 21:27:09 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad2df4e-bb16-4db0-a2e6-28ed072a6b96 tempest-VolumesGetTest-1501840428 None] Lock "cinder-376933fd-2bc4-421d-8340-e0a7d9a7c50f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43a9878-e598-45be-b95d-a1e0349608b1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Acquiring lock "cinder-c4d17964-25af-4a10-9521-99e012ffa0b8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "cinder-c4d17964-25af-4a10-9521-99e012ffa0b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Acquiring lock "cinder-quobyte-c4d17964-25af-4a10-9521-99e012ffa0b8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "cinder-quobyte-c4d17964-25af-4a10-9521-99e012ffa0b8" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f60cf-dbe5-40ee-a7ea-96a5b5313365]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:10 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 Nov 06 21:27:10 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "cinder-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:10 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 Nov 06 21:27:10 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee9013-b051-422d-beaf-9d0326cbe1ff]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 Nov 06 21:27:10 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3" returned: 0 in 0.591s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 2G" returned: 0 in 0.108s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.740s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:11 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8 Nov 06 21:27:11 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e44d49cf-fe88-44dd-ad56-d2582c28a8dd tempest-VolumesExtendTest-1390046812 None] Extend volume completed successfully. Nov 06 21:27:11 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8 Nov 06 21:27:11 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c4d17964-25af-4a10-9521-99e012ffa0b8" returned: 0 in 0.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "cinder-quobyte-c4d17964-25af-4a10-9521-99e012ffa0b8" released by "delete_volume" :: held 0.859s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Created reservations ['032e45dd-c2f7-45b2-9c0d-c225538da880', 'd0a341f8-4a50-4081-912b-cf2442e165a9', 'cf7ccf7f-ee39-4c0d-a0c2-3f87c7b30b38', '89f15a98-68e2-4010-81c6-87bc19f2d850'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:11 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8" released by "delete_volume" :: held 0.842s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:11 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:11 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Created reservations ['495ad2ec-5bff-4006-9ace-f68d6877de26', '521705c3-3f36-4631-91ee-0de712a08dc7', '3f9b3b98-05e4-4251-8c1f-5356bd48c0d6', '105bdda8-be7d-4c6e-956f-c8edf0c707dd'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:11 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-779f10ea-5d60-48d7-bfb9-e7015503d8f3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-779f10ea-5d60-48d7-bfb9-e7015503d8f3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-quobyte-779f10ea-5d60-48d7-bfb9-e7015503d8f3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-779f10ea-5d60-48d7-bfb9-e7015503d8f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:12 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.629s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Deleted volume successfully. Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c922d055-fca0-4eb6-955f-77061593280b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5341315c-64ef-4504-a51d-811325131f3b tempest-VolumeImageDependencyTests-879373418 None] Lock "cinder-c4d17964-25af-4a10-9521-99e012ffa0b8-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:12 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 Nov 06 21:27:12 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:12 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.439s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1f69e14c-16b4-4524-8855-36bb9f2509f7 tempest-VolumesGetTest-1501840428 None] Lock "cinder-ab86b7bb-8a6b-45f9-85de-725b70d9d5b8-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:12 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3" returned: 0 in 0.552s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3 Nov 06 21:27:12 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-779f10ea-5d60-48d7-bfb9-e7015503d8f3" returned: 0 in 0.408s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-779f10ea-5d60-48d7-bfb9-e7015503d8f3" released by "delete_volume" :: held 1.042s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Created reservations ['0c729fb0-2dd7-4d03-a51c-1c74ccc514b1', '74ab5fd1-4c82-4186-a672-5199e69db6dd', '61db79c6-793f-4aba-b4e6-5c645b87f6ae', 'ce864025-68bc-4a72-adbe-2c3a7c409fae'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:13 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (4ee206ee-fdac-4fc5-a35c-5ab5200c72db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e9b977-205c-4475-a0e5-6f6076d70f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:13 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e9b977-205c-4475-a0e5-6f6076d70f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-359277541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a264664-90e2-43da-bd7f-a4f518c32b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:14Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6794cb92-2b1d-4dbf-afb6-89ce0a825791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6794cb92-2b1d-4dbf-afb6-89ce0a825791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4062515-b28b-4e83-a905-dc95c4960150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4062515-b28b-4e83-a905-dc95c4960150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a264664-90e2-43da-bd7f-a4f518c32b7b', 'volume_name': 'volume-1a264664-90e2-43da-bd7f-a4f518c32b7b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272e3d20-ab0a-4dbd-b101-8ef1f1a15f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272e3d20-ab0a-4dbd-b101-8ef1f1a15f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c51a001-4fad-4bad-915a-8dcd35d35f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Volume 1a264664-90e2-43da-bd7f-a4f518c32b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a264664-90e2-43da-bd7f-a4f518c32b7b', 'volume_size': 1} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-359277541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a264664-90e2-43da-bd7f-a4f518c32b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:14Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Creating volume 1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:13 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.514s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Deleted volume successfully. Nov 06 21:27:13 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b 1073741824 Nov 06 21:27:13 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3a6ba788-6e42-4a07-8995-f6cc27e35cb9 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-779f10ea-5d60-48d7-bfb9-e7015503d8f3-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:14 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b 1073741824" returned: 0 in 0.584s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:14 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:14 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:14 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.401s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c51a001-4fad-4bad-915a-8dcd35d35f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a264664-90e2-43da-bd7f-a4f518c32b7b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1664995e-b5d0-4145-b940-db4e336c4e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Volume volume-1a264664-90e2-43da-bd7f-a4f518c32b7b (1a264664-90e2-43da-bd7f-a4f518c32b7b): created successfully Nov 06 21:27:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1664995e-b5d0-4145-b940-db4e336c4e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (4ee206ee-fdac-4fc5-a35c-5ab5200c72db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dbe6671c-3202-45b0-8d8b-596f32d074c3 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Flow 'volume_create_manager' (b8f044e0-c3d5-4b91-ab8d-e6d83829aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de44cc2-54ec-4649-8b22-31fd493657f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de44cc2-54ec-4649-8b22-31fd493657f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755817923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed353573-98b2-4653-92cc-1d28bb3f5fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17985eb2ab234177ad1f640d7dbc4e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:15Z,use_quota=True,user_id='3cdc7c4dca264504b9ee0c065c8a461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7a66b1-e795-4804-9e8a-de5425f82c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7a66b1-e795-4804-9e8a-de5425f82c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14311d-f306-4d14-a40b-c6d44c06ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14311d-f306-4d14-a40b-c6d44c06ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed353573-98b2-4653-92cc-1d28bb3f5fb2', 'volume_name': 'volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb76d24-925d-4806-b209-947d599903b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb76d24-925d-4806-b209-947d599903b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0347fdb2-87df-4a0d-acc0-cdb7ded0bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Volume ed353573-98b2-4653-92cc-1d28bb3f5fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2', 'volume_size': 1} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755817923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed353573-98b2-4653-92cc-1d28bb3f5fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17985eb2ab234177ad1f640d7dbc4e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:15Z,use_quota=True,user_id='3cdc7c4dca264504b9ee0c065c8a461c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Creating volume ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 1073741824 Nov 06 21:27:15 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:15 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 1073741824" returned: 0 in 0.666s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:15 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.332s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0347fdb2-87df-4a0d-acc0-cdb7ded0bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05be36ee-d0f0-4945-9ee1-f0595c0d352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Volume volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 (ed353573-98b2-4653-92cc-1d28bb3f5fb2): created successfully Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05be36ee-d0f0-4945-9ee1-f0595c0d352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Flow 'volume_create_manager' (b8f044e0-c3d5-4b91-ab8d-e6d83829aba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Flow 'volume_create_manager' (cfaaf255-8855-4178-9474-af9bb40ccae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa8311a-81b8-4429-8efd-e09d68a362ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-60e21c9b-d0fc-45c9-9675-df094ca7f0d1 tempest-VolumesExtendTest-1390046812 None] Created volume successfully. Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa8311a-81b8-4429-8efd-e09d68a362ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b7759a-0262-4326-a8f8-5f390a1ea585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94546d5c26845e498658fbaa28c1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:16Z,use_quota=True,user_id='331866c6615a42948cb5438677f5be3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e21d42-f870-42f7-b7dc-db5bf1505382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e21d42-f870-42f7-b7dc-db5bf1505382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab13e031-a6e7-4e27-8a62-7ca286e8785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab13e031-a6e7-4e27-8a62-7ca286e8785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b7759a-0262-4326-a8f8-5f390a1ea585', 'volume_name': 'volume-87b7759a-0262-4326-a8f8-5f390a1ea585', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917c041f-aeb3-4aaa-b4e3-77cb2dc97b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917c041f-aeb3-4aaa-b4e3-77cb2dc97b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea52501f-3035-435a-80df-daa75bb97745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Volume 87b7759a-0262-4326-a8f8-5f390a1ea585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b7759a-0262-4326-a8f8-5f390a1ea585', 'volume_size': 1} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b7759a-0262-4326-a8f8-5f390a1ea585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94546d5c26845e498658fbaa28c1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:16Z,use_quota=True,user_id='331866c6615a42948cb5438677f5be3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Creating volume 87b7759a-0262-4326-a8f8-5f390a1ea585 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 1073741824 Nov 06 21:27:16 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (c76fe3fa-8414-4eb4-9844-d3a2c0795737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9bb6f6-cc37-414c-9bd2-b73158905f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9bb6f6-cc37-414c-9bd2-b73158905f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1770298377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2876fe4-6ec2-4465-b076-cfaa293b6f3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1a264664-90e2-43da-bd7f-a4f518c32b7b,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:17Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da828c2-dd47-4101-a942-ed3bb402d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da828c2-dd47-4101-a942-ed3bb402d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9755af1-c52c-428a-b162-962548d4971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9755af1-c52c-428a-b162-962548d4971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b2876fe4-6ec2-4465-b076-cfaa293b6f3c', 'volume_name': 'volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c', 'volume_size': 1, 'source_volid': '1a264664-90e2-43da-bd7f-a4f518c32b7b', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90f092c-958b-49e2-9167-dd11a2d2c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90f092c-958b-49e2-9167-dd11a2d2c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0da804-4d4c-46a7-81ed-bb7c85cd2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Volume b2876fe4-6ec2-4465-b076-cfaa293b6f3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c', 'volume_size': 1, 'source_volid': '1a264664-90e2-43da-bd7f-a4f518c32b7b', 'source_volstatus': 'available'} Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:16 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 1073741824" returned: 0 in 0.556s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 Nov 06 21:27:17 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.614s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Cloning volume 1a264664-90e2-43da-bd7f-a4f518c32b7b to volume b2876fe4-6ec2-4465-b076-cfaa293b6f3c Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea52501f-3035-435a-80df-daa75bb97745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b7759a-0262-4326-a8f8-5f390a1ea585', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f6138-f768-4a00-a685-e969d34b476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Volume volume-87b7759a-0262-4326-a8f8-5f390a1ea585 (87b7759a-0262-4326-a8f8-5f390a1ea585): created successfully Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f6138-f768-4a00-a685-e969d34b476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Flow 'volume_create_manager' (cfaaf255-8855-4178-9474-af9bb40ccae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Creating offline snapshot fb8943f2-1222-4661-bcae-4c9260aa339a of volume 1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-13d0dcd0-b9dc-4bda-8bc1-09fcfff39718 tempest-CinderUnicodeTest-1923760777 None] Created volume successfully. Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f2d447-a249-42ad-a41c-e7e30eec98b3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:17 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.406s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a 1G Nov 06 21:27:17 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a 1G" returned: 0 in 0.474s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a264664-90e2-43da-bd7f-a4f518c32b7b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a264664-90e2-43da-bd7f-a4f518c32b7b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:18 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a264664-90e2-43da-bd7f-a4f518c32b7b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.347s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a is being set with open permissions: ugo+rw Nov 06 21:27:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:18 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Flow 'volume_create_manager' (985e1379-6089-4f89-9854-094e37918a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5e1c36-1e4d-409d-8408-1b5d98fbb92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5e1c36-1e4d-409d-8408-1b5d98fbb92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-928370843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67750ff-6c8c-4111-8aad-d0e00d4ae91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94546d5c26845e498658fbaa28c1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:19Z,use_quota=True,user_id='331866c6615a42948cb5438677f5be3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8c32f7-aa15-463b-9848-75780809942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8c32f7-aa15-463b-9848-75780809942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafa7c2f-7fd5-4a15-a5c3-dc80d956ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafa7c2f-7fd5-4a15-a5c3-dc80d956ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67750ff-6c8c-4111-8aad-d0e00d4ae91e', 'volume_name': 'volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f9afb-c587-4509-a31c-29f4acd73165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f9afb-c587-4509-a31c-29f4acd73165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9861682-f601-45b6-985b-886194e8ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Volume e67750ff-6c8c-4111-8aad-d0e00d4ae91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e', 'volume_size': 1} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:19 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info Nov 06 21:27:19 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info" returned: 0 in 0.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info is being set with open permissions: ugo+rw Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info Nov 06 21:27:19 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.info" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] snapshot: fb8943f2-1222-4661-bcae-4c9260aa339a, volume: b2876fe4-6ec2-4465-b076-cfaa293b6f3c, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541ce2d-47a5-419f-a61c-e0637dcac59e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:19 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:19 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:20 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.386s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a264664-90e2-43da-bd7f-a4f518c32b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4cdf99-a87c-4b25-b795-aeb694ce9b67]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:20 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:20 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.400s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:27:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c Nov 06 21:27:20 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:28 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" returned: 0 in 7.487s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:28 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Converted 1024.00 MB image at 136.75 MB/s Nov 06 21:27:28 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c is being set with open permissions: ugo+rw Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:28 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c Nov 06 21:27:28 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:28 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" released by "_copy_volume_from_snapshot" :: held 8.652s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-fb8943f2-1222-4661-bcae-4c9260aa339a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-fb8943f2-1222-4661-bcae-4c9260aa339a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Deleting offline snapshot fb8943f2-1222-4661-bcae-4c9260aa339a of volume 1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] snapshot_file for this snap is: volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0400dfc-6789-46f0-a7e3-69f8300de600]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:28 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:28 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:28 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a264664-90e2-43da-bd7f-a4f518c32b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc523e6d-b13c-4a9c-87d8-7ddf6b5bd37d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:29 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:29 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:29 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=72,cinder:SELECT=57,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:29 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.589s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:29 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:29 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:29 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.415s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:30 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a Nov 06 21:27:30 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:30 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b.fb8943f2-1222-4661-bcae-4c9260aa339a" returned: 0 in 0.261s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-fb8943f2-1222-4661-bcae-4c9260aa339a" released by "_delete_snapshot" :: held 1.800s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.989s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.901s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0da804-4d4c-46a7-81ed-bb7c85cd2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c', 'volume_size': 1, 'source_volid': '1a264664-90e2-43da-bd7f-a4f518c32b7b', 'source_volstatus': 'available'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eabe52b-b444-4ccf-aa1f-2cf934375339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Creating offline snapshot 9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b of volume ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Volume volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c (b2876fe4-6ec2-4465-b076-cfaa293b6f3c): created successfully Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eabe52b-b444-4ccf-aa1f-2cf934375339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (c76fe3fa-8414-4eb4-9844-d3a2c0795737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198226f-b325-4035-9080-53c014d2d6d0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-26de5350-bb3a-425d-9add-5f3933200ea4 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:30 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:30 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:30 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.427s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:30 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b 1G Nov 06 21:27:30 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:31 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b 1G" returned: 0 in 0.488s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:31 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b Nov 06 21:27:31 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:31 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (92583726-76fe-4404-b33c-a9f9dcea2832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c230f41-fc96-443c-b7ad-100f442dc709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" returned: 0 in 0.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:31 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b is being set with open permissions: ugo+rw Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c230f41-fc96-443c-b7ad-100f442dc709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-849793908',display_name='tempest-VolumesGetTest-Volume-1171866634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94136055-4788-41d9-88da-83d5dcf34cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:32Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4619356-30b9-4af1-ae7f-cd2497fcb3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:31 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b Nov 06 21:27:31 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4619356-30b9-4af1-ae7f-cd2497fcb3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69da7b0a-1aa4-4320-8433-78ebcb0bf961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69da7b0a-1aa4-4320-8433-78ebcb0bf961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94136055-4788-41d9-88da-83d5dcf34cef', 'volume_name': 'volume-94136055-4788-41d9-88da-83d5dcf34cef', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bcdc51-4625-48e9-a329-09b915ef4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bcdc51-4625-48e9-a329-09b915ef4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2599eab-f01d-4fa2-8a60-9bf9c06f6997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Volume 94136055-4788-41d9-88da-83d5dcf34cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94136055-4788-41d9-88da-83d5dcf34cef', 'volume_size': 1} Nov 06 21:27:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:32 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info Nov 06 21:27:32 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info is being set with open permissions: ugo+rw Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info Nov 06 21:27:32 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.info" returned: 0 in 0.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.676s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-928370843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67750ff-6c8c-4111-8aad-d0e00d4ae91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94546d5c26845e498658fbaa28c1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:19Z,use_quota=True,user_id='331866c6615a42948cb5438677f5be3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Creating volume e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:32 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e 1073741824 Nov 06 21:27:32 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b52376eb-d583-4f4e-9593-1f4b36d17517 tempest-VolumesExtendTest-1390046812 None] Create snapshot completed successfully Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:33 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e 1073741824" returned: 0 in 0.639s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:33 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e Nov 06 21:27:33 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:33 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" returned: 0 in 0.357s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-849793908',display_name='tempest-VolumesGetTest-Volume-1171866634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94136055-4788-41d9-88da-83d5dcf34cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:32Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Creating volume 94136055-4788-41d9-88da-83d5dcf34cef {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:33 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9861682-f601-45b6-985b-886194e8ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:33 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef 1073741824 Nov 06 21:27:33 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d5f9fe-798d-4d40-a827-67dc1a712cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:33 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Volume volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e (e67750ff-6c8c-4111-8aad-d0e00d4ae91e): created successfully Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d5f9fe-798d-4d40-a827-67dc1a712cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Flow 'volume_create_manager' (985e1379-6089-4f89-9854-094e37918a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-73b9d6ea-22dd-4360-90ef-bd6c6de6b343 tempest-CinderUnicodeTest-1923760777 None] Created volume successfully. Nov 06 21:27:34 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef 1073741824" returned: 0 in 0.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:34 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef Nov 06 21:27:34 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:34 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef" returned: 0 in 0.341s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.425s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2599eab-f01d-4fa2-8a60-9bf9c06f6997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94136055-4788-41d9-88da-83d5dcf34cef', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d35cd9-95cd-48f0-865a-58391bcdedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddba02b-dc78-4c7b-ab58-24bc7e7c4cff]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Volume volume-94136055-4788-41d9-88da-83d5dcf34cef (94136055-4788-41d9-88da-83d5dcf34cef): created successfully Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d35cd9-95cd-48f0-865a-58391bcdedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (92583726-76fe-4404-b33c-a9f9dcea2832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-af3875e3-b894-4abe-9a93-bbe509eec05c tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:35 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:35 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:35 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.469s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b 2G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b 2G" returned: 0 in 0.165s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.697s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.826s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Creating offline snapshot 47029407-1a12-4ea8-ac07-b29060707447 of volume e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5133fa-520b-4141-9d9c-df1b6dd4146a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b039fcc-51b2-4737-b185-c8b616cdcf2a tempest-VolumesExtendTest-1390046812 None] Extend volume completed successfully. Nov 06 21:27:35 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e Nov 06 21:27:35 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-94136055-4788-41d9-88da-83d5dcf34cef-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" returned: 0 in 0.657s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "cinder-94136055-4788-41d9-88da-83d5dcf34cef-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:36 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 1G Nov 06 21:27:36 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-94136055-4788-41d9-88da-83d5dcf34cef" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-94136055-4788-41d9-88da-83d5dcf34cef" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[46516456-1187-466f-85ca-47ffaff04189]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:36 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef Nov 06 21:27:36 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 1G" returned: 0 in 0.638s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:36 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 Nov 06 21:27:36 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:36 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef" returned: 0 in 0.544s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:36 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef Nov 06 21:27:37 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-quobyte-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Deleting offline snapshot 9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b of volume ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] snapshot_file for this snap is: volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9d8f43-437f-4034-8c81-d09a69d2d371]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94136055-4788-41d9-88da-83d5dcf34cef" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b Nov 06 21:27:37 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-94136055-4788-41d9-88da-83d5dcf34cef" released by "delete_volume" :: held 0.980s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 is being set with open permissions: ugo+rw Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 Nov 06 21:27:37 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Created reservations ['75a3f85b-c0e6-4efc-b19d-4ec24ed91685', '1e09577c-c7f9-4332-a112-e7d376196448', '4b3cdf2e-bfa2-4a79-8b4c-80e4c7b3e74d', '3a562005-a683-4c5d-9f8c-4a1cc583a544'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:37 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" returned: 0 in 0.500s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c83c401-97ef-4941-8cac-8a12685cee1d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447" returned: 0 in 0.392s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:37 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:37 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info Nov 06 21:27:37 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:37 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.329s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6fc84ef0-f4e5-4a52-9ed6-fa3d8ce3f76f tempest-VolumesGetTest-1501840428 None] Lock "cinder-94136055-4788-41d9-88da-83d5dcf34cef-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:38 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info is being set with open permissions: ugo+rw Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:38 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info Nov 06 21:27:38 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:38 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:38 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b Nov 06 21:27:38 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.info" returned: 0 in 0.384s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:27:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b1df44dc-cac8-45d0-8d74-77b5b8cea98f tempest-CinderUnicodeTest-1923760777 None] Create snapshot completed successfully Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-b2876fe4-6ec2-4465-b076-cfaa293b6f3c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "cinder-b2876fe4-6ec2-4465-b076-cfaa293b6f3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:38 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" returned: 0 in 0.593s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:38 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b Nov 06 21:27:38 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04bc6c7-cdae-41cd-b41c-9d1029762f54]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c Nov 06 21:27:39 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-47029407-1a12-4ea8-ac07-b29060707447-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-47029407-1a12-4ea8-ac07-b29060707447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-quobyte-47029407-1a12-4ea8-ac07-b29060707447" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:39 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-47029407-1a12-4ea8-ac07-b29060707447" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Deleting offline snapshot 47029407-1a12-4ea8-ac07-b29060707447 of volume e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] snapshot_file for this snap is: volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2.9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985e41a-59b4-4bf4-8140-2e249f3ec27e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b" released by "_delete_snapshot" :: held 2.126s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" released by "delete_snapshot" :: held 2.155s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Created reservations ['af4f5abd-74cb-4120-a33f-64a2bb060997', '85608db1-2de1-4df0-8bc7-24aaecccc407', 'd9198ef3-9994-49cb-9a41-0e161b63d71d', 'e616a64c-c6c7-4217-b17c-23e37bdcad9b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:39 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 Nov 06 21:27:39 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" returned: 0 in 0.523s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Delete snapshot completed successfully. Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b984f7-807e-45f2-8c4e-f18d95d9c391 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-9a3c6cc1-b2c5-4a3d-853b-3b2e9134df5b-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:39 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c Nov 06 21:27:39 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447" returned: 0 in 0.427s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5c579-8514-4c33-89b3-077c040c06c3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-b2876fe4-6ec2-4465-b076-cfaa293b6f3c" released by "delete_volume" :: held 0.901s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Created reservations ['cb40b5c0-5e83-4327-a74d-24213ee2b369', '6862a698-ef88-4c4b-9bc5-567aeca9db39', 'd29251dd-77cd-44ef-aa28-4c7430f26dbc', 'f8bb0ba8-84ea-4a7a-9592-5f05ef5c0dfa'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:39 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e Nov 06 21:27:39 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:39 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:39 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-1a264664-90e2-43da-bd7f-a4f518c32b7b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "cinder-1a264664-90e2-43da-bd7f-a4f518c32b7b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-1a264664-90e2-43da-bd7f-a4f518c32b7b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-1a264664-90e2-43da-bd7f-a4f518c32b7b" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3710e711-ffd6-40f7-aba2-3fa82eb4c7ed]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" returned: 0 in 0.606s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 Nov 06 21:27:40 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:40 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:40 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-ed353573-98b2-4653-92cc-1d28bb3f5fb2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1fec3737-6ebc-48c6-bf25-e5d078232606 tempest-VolumesGetTest-1501840428 None] Lock "cinder-b2876fe4-6ec2-4465-b076-cfaa293b6f3c-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-ed353573-98b2-4653-92cc-1d28bb3f5fb2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9087228-089e-4505-aa4d-e3b1de5abd4e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.541s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447" returned: 0 in 0.544s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:40 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b Nov 06 21:27:40 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:40 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447 Nov 06 21:27:40 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.473s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:41 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e.47029407-1a12-4ea8-ac07-b29060707447" returned: 0 in 0.345s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2 Nov 06 21:27:41 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a264664-90e2-43da-bd7f-a4f518c32b7b" returned: 0 in 0.439s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-47029407-1a12-4ea8-ac07-b29060707447" released by "_delete_snapshot" :: held 2.138s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" released by "delete_snapshot" :: held 2.173s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-1a264664-90e2-43da-bd7f-a4f518c32b7b" released by "delete_volume" :: held 1.089s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Created reservations ['2cb966ed-47e2-47ad-ac85-456f6879e44d', 'efe443d0-4d5d-45aa-acf3-242e3a086eb0', 'cee042dc-92cf-4f3a-ae6b-9dfcfe671c6d', '61a6b038-b66f-42a0-b6f1-52cb443a42e8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Created reservations ['ebddf521-aeed-4ec3-9b86-b8a2bf45e6b8', '6ca52396-abec-4263-8cf9-21915cd9f51d', 'f882247a-355b-4a24-8ff2-826225d9392d', 'e397ea2b-db8d-485b-88ad-0afac06daead'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Delete snapshot completed successfully. Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-260b9060-4232-4dbc-9032-afae9d438099 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-47029407-1a12-4ea8-ac07-b29060707447-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:41 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ed353573-98b2-4653-92cc-1d28bb3f5fb2" returned: 0 in 0.338s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-quobyte-ed353573-98b2-4653-92cc-1d28bb3f5fb2" released by "delete_volume" :: held 0.941s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:41 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:41 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Created reservations ['918c4987-bd75-428d-a8ca-7bceff669420', '2bbe3a81-fd91-470d-8d78-7523a6b19381', '31e93288-f831-4c86-b067-c304b8c4bba2', '98f0448b-9c1e-45de-970d-a75c0c7fccfe'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:41 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-816ba63c-4c52-4a91-a74f-209b38c61457 tempest-VolumesGetTest-1501840428 None] Lock "cinder-1a264664-90e2-43da-bd7f-a4f518c32b7b-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:42 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Deleted volume successfully. Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dad4bfb5-6642-4aac-8d12-6f573f2eb580 tempest-VolumesExtendTest-1390046812 None] Lock "cinder-ed353573-98b2-4653-92cc-1d28bb3f5fb2-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-e67750ff-6c8c-4111-8aad-d0e00d4ae91e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-e67750ff-6c8c-4111-8aad-d0e00d4ae91e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebf95d-78dd-46ac-9caf-35651953e775]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:42 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e Nov 06 21:27:42 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:43 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" returned: 0 in 0.586s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:43 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e Nov 06 21:27:43 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:43 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-e67750ff-6c8c-4111-8aad-d0e00d4ae91e" released by "delete_volume" :: held 1.100s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (8922f240-9ef5-4006-aeb9-870435055ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e851b6-11a6-4cbd-8b67-562cf0549904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e851b6-11a6-4cbd-8b67-562cf0549904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1925126330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45ed141-7e80-404c-b9a5-607088571967,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:43Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ff5d64-8743-43d3-92f5-901ab838c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ff5d64-8743-43d3-92f5-901ab838c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5460d2-973a-41ae-8784-bfd3994b847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Created reservations ['63d352e8-11c6-4571-b962-769960f3da8f', 'f3fad4e3-e79d-4a24-a476-c2fdd5082e00', '12f6a00d-69d7-479c-993c-33c179ae3682', 'eb18f9f1-55f5-4477-b133-509f438d4831'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:43 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:43 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:44 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Deleted volume successfully. Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5460d2-973a-41ae-8784-bfd3994b847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a45ed141-7e80-404c-b9a5-607088571967', 'volume_name': 'volume-a45ed141-7e80-404c-b9a5-607088571967', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16014b60-1dbe-44a1-861c-6c59cd71fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16014b60-1dbe-44a1-861c-6c59cd71fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06424b77-437b-43bc-b402-01afc2db6b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Volume a45ed141-7e80-404c-b9a5-607088571967: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a45ed141-7e80-404c-b9a5-607088571967', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Trying to clone a45ed141-7e80-404c-b9a5-607088571967 from image 007d3188-64b0-400e-a10b-94dd7e89a175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8d8602fa-e584-4de9-a432-c19fda57916d tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-e67750ff-6c8c-4111-8aad-d0e00d4ae91e-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-87b7759a-0262-4326-a8f8-5f390a1ea585-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-87b7759a-0262-4326-a8f8-5f390a1ea585-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "cinder-quobyte-87b7759a-0262-4326-a8f8-5f390a1ea585" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:27:44 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-87b7759a-0262-4326-a8f8-5f390a1ea585" acquired by "delete_volume" :: waited 0.065s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a9416-bf0b-41da-ba38-8e1ae74b6401]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e7e4d2-1d74-4084-8b59-6c34b781465a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:45 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 Nov 06 21:27:45 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:45 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD Nov 06 21:27:45 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:45 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 is fetched for user d1dcee7d1c394ab28596512be2b36b18. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:27:45 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585" returned: 0 in 0.544s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:45 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585 Nov 06 21:27:45 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece1309a-dd02-4241-88ae-657a6b75c507]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:45 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD Nov 06 21:27:45 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:45 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-87b7759a-0262-4326-a8f8-5f390a1ea585" returned: 0 in 0.408s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-quobyte-87b7759a-0262-4326-a8f8-5f390a1ea585" released by "delete_volume" :: held 1.050s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Created reservations ['7986e4c8-edb2-4c2d-a696-7dd8228e90de', 'f38ef907-6cf7-4cc6-96d8-d51dad5b35d2', '1bea60f6-42c3-4937-9242-e9b7bb5d3d01', '3e4660ee-018f-442b-b4f7-b3ac9a9dfdda'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:46 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1925126330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45ed141-7e80-404c-b9a5-607088571967,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:43Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Creating volume a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1073741824 Nov 06 21:27:46 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:46 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.574s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Deleted volume successfully. Nov 06 21:27:46 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1073741824" returned: 0 in 0.714s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6d4d692c-8149-4e1e-9cab-3d376269a921 tempest-CinderUnicodeTest-1923760777 None] Lock "cinder-87b7759a-0262-4326-a8f8-5f390a1ea585-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 Nov 06 21:27:46 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:47 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967" returned: 0 in 0.559s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Attempting download of 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume a45ed141-7e80-404c-b9a5-607088571967. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490679c-e023-48dc-8200-3015ad4756e0]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:47 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk Nov 06 21:27:47 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:48 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk" returned: 0 in 0.466s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:48 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk Nov 06 21:27:48 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:48 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk" returned: 1 in 0.510s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_6ksq8gdk' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e7bbb-024c-4e3e-9b58-67480b1b6ae7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:48 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD Nov 06 21:27:48 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:49 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD" returned: 0 in 0.610s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:49 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] 007d3188-64b0-400e-a10b-94dd7e89a175 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:49 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 Nov 06 21:27:49 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Flow 'volume_create_manager' (31dd300c-298d-4c50-a109-d58ded06332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f61e18c-9c6b-49ba-8a93-c6fd245ba3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f61e18c-9c6b-49ba-8a93-c6fd245ba3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-574254628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d337d84-9843-48db-99e2-740d36caf438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b770536a45487b83a4d2984d37cc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:50Z,use_quota=True,user_id='cb69005f2c5a4bffa3521f45d10f007c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4186b-f62f-4e8b-9d17-018851384aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4186b-f62f-4e8b-9d17-018851384aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e381fb85-d754-4e3d-837f-c785b7120d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e381fb85-d754-4e3d-837f-c785b7120d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d337d84-9843-48db-99e2-740d36caf438', 'volume_name': 'volume-2d337d84-9843-48db-99e2-740d36caf438', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0dcdbf-5191-4ec2-832f-0413e482ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0dcdbf-5191-4ec2-832f-0413e482ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ca3b51-ba37-4a53-9fcf-806c3b0592a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Volume 2d337d84-9843-48db-99e2-740d36caf438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d337d84-9843-48db-99e2-740d36caf438', 'volume_size': 1} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-574254628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d337d84-9843-48db-99e2-740d36caf438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b770536a45487b83a4d2984d37cc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:50Z,use_quota=True,user_id='cb69005f2c5a4bffa3521f45d10f007c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Creating volume 2d337d84-9843-48db-99e2-740d36caf438 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:50 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:50 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 1073741824 Nov 06 21:27:50 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 1073741824" returned: 0 in 0.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:51 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 Nov 06 21:27:51 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:51 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ca3b51-ba37-4a53-9fcf-806c3b0592a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d337d84-9843-48db-99e2-740d36caf438', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aab83a-b8e9-46d2-8e38-f811bf520e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:51 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Volume volume-2d337d84-9843-48db-99e2-740d36caf438 (2d337d84-9843-48db-99e2-740d36caf438): created successfully Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aab83a-b8e9-46d2-8e38-f811bf520e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Flow 'volume_create_manager' (31dd300c-298d-4c50-a109-d58ded06332c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f2263c5-972f-4ca2-804d-8ffdd5d73847 tempest-VolumesNegativeTest-1547543685 None] Created volume successfully. Nov 06 21:27:51 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967" returned: 0 in 2.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_eud79sv2devstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:51 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Converted 112.00 MB image at 41.85 MB/s Nov 06 21:27:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:51 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1G Nov 06 21:27:51 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:52 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 1G" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Downloaded image 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume a45ed141-7e80-404c-b9a5-607088571967 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 for user d1dcee7d1c394ab28596512be2b36b18 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Marking volume a45ed141-7e80-404c-b9a5-607088571967 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Copying metadata from image 007d3188-64b0-400e-a10b-94dd7e89a175 to a45ed141-7e80-404c-b9a5-607088571967. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Creating volume glance metadata for volume a45ed141-7e80-404c-b9a5-607088571967 backed by image 007d3188-64b0-400e-a10b-94dd7e89a175 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06424b77-437b-43bc-b402-01afc2db6b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45ed141-7e80-404c-b9a5-607088571967', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962f2997-76cf-443c-92bc-4bbf1afb2363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Volume volume-a45ed141-7e80-404c-b9a5-607088571967 (a45ed141-7e80-404c-b9a5-607088571967): created successfully Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962f2997-76cf-443c-92bc-4bbf1afb2363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (8922f240-9ef5-4006-aeb9-870435055ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ecf46154-c87c-4c9d-bbfd-6e09876abe23 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Flow 'volume_create_manager' (e130ce4b-eb9b-44d4-bc1e-f2e5f5e6c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafb8d76-4dd4-4fec-aeed-7876fa795fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafb8d76-4dd4-4fec-aeed-7876fa795fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-116798408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be1ca03-f1e0-4be5-9c77-a2c304d59d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ca3d2385264d28b7610f04dd1c987e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:54Z,use_quota=True,user_id='d69c158928644819ae256e529ef079c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1604673a-c050-448b-a701-2594dcd81dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1604673a-c050-448b-a701-2594dcd81dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19857bb7-3add-4088-be2e-41966a0dc6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19857bb7-3add-4088-be2e-41966a0dc6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be1ca03-f1e0-4be5-9c77-a2c304d59d31', 'volume_name': 'volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b68af-bbc9-425f-967a-c4400ed0959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b68af-bbc9-425f-967a-c4400ed0959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2bf364-a04b-40e9-8fab-9784629f0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Volume 1be1ca03-f1e0-4be5-9c77-a2c304d59d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31', 'volume_size': 1} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-116798408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be1ca03-f1e0-4be5-9c77-a2c304d59d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ca3d2385264d28b7610f04dd1c987e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:54Z,use_quota=True,user_id='d69c158928644819ae256e529ef079c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Creating volume 1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:54 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:54 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 1073741824 Nov 06 21:27:54 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (bc1bc365-929c-40ef-9a1b-5212c6b1be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450d4022-4e57-4938-ad94-344e922fa40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450d4022-4e57-4938-ad94-344e922fa40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1877344134',display_name='tempest-VolumesGetTest-Volume-1446826989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd28a35-305e-455f-8540-4b5eceb1738e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:55Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cca5dc-0d3f-4ebd-96d9-75ef08a89640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cca5dc-0d3f-4ebd-96d9-75ef08a89640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058ef222-4474-4a75-8c28-cf9f9b77f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058ef222-4474-4a75-8c28-cf9f9b77f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd28a35-305e-455f-8540-4b5eceb1738e', 'volume_name': 'volume-6dd28a35-305e-455f-8540-4b5eceb1738e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef80fa1-e011-4918-b900-ec92f918c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef80fa1-e011-4918-b900-ec92f918c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cdf8f-fa5a-4460-b5b3-13a987e1ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Volume 6dd28a35-305e-455f-8540-4b5eceb1738e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd28a35-305e-455f-8540-4b5eceb1738e', 'volume_size': 1} Nov 06 21:27:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:55 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 1073741824" returned: 0 in 0.902s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:55 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:27:55 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:55 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1877344134',display_name='tempest-VolumesGetTest-Volume-1446826989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd28a35-305e-455f-8540-4b5eceb1738e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087d3ea571c64ae68e703222a44e8eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:55Z,use_quota=True,user_id='d1dcee7d1c394ab28596512be2b36b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Creating volume 6dd28a35-305e-455f-8540-4b5eceb1738e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2bf364-a04b-40e9-8fab-9784629f0756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:55 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e 1073741824 Nov 06 21:27:55 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fcf0b3-afeb-42f8-828c-75d2808adbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Volume volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 (1be1ca03-f1e0-4be5-9c77-a2c304d59d31): created successfully Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fcf0b3-afeb-42f8-828c-75d2808adbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Flow 'volume_create_manager' (e130ce4b-eb9b-44d4-bc1e-f2e5f5e6c20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-432372b3-c69e-4b8c-9cb8-3fee50d46646 tempest-TestStampPattern-134097027 None] Created volume successfully. Nov 06 21:27:56 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e 1073741824" returned: 0 in 0.783s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:56 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e Nov 06 21:27:56 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:56 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cdf8f-fa5a-4460-b5b3-13a987e1ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd28a35-305e-455f-8540-4b5eceb1738e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ce69e3-00a9-496d-866c-51d596fad81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:57 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Volume volume-6dd28a35-305e-455f-8540-4b5eceb1738e (6dd28a35-305e-455f-8540-4b5eceb1738e): created successfully Nov 06 21:27:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ce69e3-00a9-496d-866c-51d596fad81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:57 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Flow 'volume_create_manager' (bc1bc365-929c-40ef-9a1b-5212c6b1be39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dd1f05ea-d007-4f79-abf3-2103ca6dae83 tempest-VolumesGetTest-1501840428 None] Created volume successfully. Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-6dd28a35-305e-455f-8540-4b5eceb1738e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "cinder-6dd28a35-305e-455f-8540-4b5eceb1738e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-6dd28a35-305e-455f-8540-4b5eceb1738e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-6dd28a35-305e-455f-8540-4b5eceb1738e" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2c072-18f2-4dd2-9ec0-e996830aa62c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:58 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e Nov 06 21:27:58 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:58 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e" returned: 0 in 0.491s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:58 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e Nov 06 21:27:58 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:59 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dd28a35-305e-455f-8540-4b5eceb1738e" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-6dd28a35-305e-455f-8540-4b5eceb1738e" released by "delete_volume" :: held 0.894s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Created reservations ['47f3ac16-7130-4821-9e4b-d487c24b83ea', 'cc7763b0-2375-4253-88de-83dbb110b74d', '2177b2c2-b61a-4277-ba1c-30a218a86213', '60d41013-8f66-4ba9-9930-4500df833568'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:59 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:27:59 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-a45ed141-7e80-404c-b9a5-607088571967-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "cinder-a45ed141-7e80-404c-b9a5-607088571967-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Acquiring lock "cinder-quobyte-a45ed141-7e80-404c-b9a5-607088571967" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-a45ed141-7e80-404c-b9a5-607088571967" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c96c31-282e-4620-9bd2-5a624fffa5e5]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:59 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:27:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c6dba4a8-3d43-4556-80ee-ee9d356509e3 tempest-VolumesGetTest-1501840428 None] Lock "cinder-6dd28a35-305e-455f-8540-4b5eceb1738e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:00 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 Nov 06 21:28:00 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:00 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967" returned: 0 in 0.760s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:00 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967 Nov 06 21:28:00 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:00 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a45ed141-7e80-404c-b9a5-607088571967" returned: 0 in 0.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "cinder-quobyte-a45ed141-7e80-404c-b9a5-607088571967" released by "delete_volume" :: held 1.340s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=125,cinder:UPDATE=158,cinder:INSERT=54,cinder:DELETE=11 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Created reservations ['d7180e8c-3977-47a9-80ad-1a8299536845', '04649128-4e8a-4968-a27e-6c5f7147383c', '5f8595d3-a685-4cdd-823c-4326fad79881', 'b125539f-037f-49c0-8638-01c32c71e400'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:01 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:01 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:01 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.343s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Deleted volume successfully. Nov 06 21:28:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b7d4afd1-6496-4512-b575-d5b4f0844a8f tempest-VolumesGetTest-1501840428 None] Lock "cinder-a45ed141-7e80-404c-b9a5-607088571967-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:11 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=103,cinder:SELECT=82,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:11 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Acquiring lock "cinder-2d337d84-9843-48db-99e2-740d36caf438-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "cinder-2d337d84-9843-48db-99e2-740d36caf438-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Acquiring lock "cinder-quobyte-2d337d84-9843-48db-99e2-740d36caf438" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "cinder-quobyte-2d337d84-9843-48db-99e2-740d36caf438" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888f58d-d7e0-4e3d-a4a8-0b8e00f631e0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:17 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 Nov 06 21:28:17 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:17 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438" returned: 0 in 0.516s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:17 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438 Nov 06 21:28:17 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:18 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2d337d84-9843-48db-99e2-740d36caf438" returned: 0 in 0.310s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "cinder-quobyte-2d337d84-9843-48db-99e2-740d36caf438" released by "delete_volume" :: held 0.911s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Created reservations ['51e1abcc-a70f-45b5-8d1d-9d49be7f061c', 'b1e738f8-7cd3-4ecf-9e2e-965ce02eee03', 'b2f8c037-d060-4aeb-9b5e-092c256f2128', 'dfdc6b7d-b53c-4cb9-a6dc-ba52770fc8d0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:18 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:18 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:18 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Deleted volume successfully. Nov 06 21:28:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e8772a8f-75dc-43c1-9a01-43df27e23310 tempest-VolumesNegativeTest-1547543685 None] Lock "cinder-2d337d84-9843-48db-99e2-740d36caf438-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (5a20115f-d82f-4d7c-9d5f-376708c78022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0220f11e-6316-4947-a718-0888455c3a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0220f11e-6316-4947-a718-0888455c3a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-82668384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6617a7e9-d349-443a-8bdc-6ff3b7af64cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:22Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d7eb74-1c71-4500-9073-32a7826e19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d7eb74-1c71-4500-9073-32a7826e19af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6c354d-9b7b-4394-a9d8-dc7cd057823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6c354d-9b7b-4394-a9d8-dc7cd057823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6617a7e9-d349-443a-8bdc-6ff3b7af64cb', 'volume_name': 'volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464d847b-6485-42d4-bc04-8566efbd7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464d847b-6485-42d4-bc04-8566efbd7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e80f34-490c-4abd-91be-8277e64733bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Volume 6617a7e9-d349-443a-8bdc-6ff3b7af64cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb', 'volume_size': 1} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-82668384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6617a7e9-d349-443a-8bdc-6ff3b7af64cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:22Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Creating volume 6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:21 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:21 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb 1073741824 Nov 06 21:28:21 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:22 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb 1073741824" returned: 0 in 0.465s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:22 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb Nov 06 21:28:22 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:22 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" returned: 0 in 0.284s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e80f34-490c-4abd-91be-8277e64733bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd5129b-4e2a-4100-a630-aca703fdc3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Volume volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb (6617a7e9-d349-443a-8bdc-6ff3b7af64cb): created successfully Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd5129b-4e2a-4100-a630-aca703fdc3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (5a20115f-d82f-4d7c-9d5f-376708c78022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1c0d892f-3c3f-4f33-9362-3e24b7549a85 tempest-VolumesSnapshotTestJSON-512655639 None] Created volume successfully. Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (0d816076-38e4-4c49-93c6-6ad08b63868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121ae5c-d4a1-4a58-8623-b282b763a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121ae5c-d4a1-4a58-8623-b282b763a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810519350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2422e94-3db1-4f0b-a71e-f25aa0d1c15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089dc5f6-f785-4653-8509-9d56ee356a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089dc5f6-f785-4653-8509-9d56ee356a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f72ae-cdd9-47d1-8243-d36161ee39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f72ae-cdd9-47d1-8243-d36161ee39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2422e94-3db1-4f0b-a71e-f25aa0d1c15a', 'volume_name': 'volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcefde59-cb43-4757-aa65-308607e77808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcefde59-cb43-4757-aa65-308607e77808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433480ad-de37-4e95-a953-2f003608480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume e2422e94-3db1-4f0b-a71e-f25aa0d1c15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a', 'volume_size': 1} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810519350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2422e94-3db1-4f0b-a71e-f25aa0d1c15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Creating volume e2422e94-3db1-4f0b-a71e-f25aa0d1c15a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:22 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:22 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a 1073741824 Nov 06 21:28:22 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (4025439d-be17-417f-9d19-51fa7653de4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4350438-445f-472e-9914-040ed0e59d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4350438-445f-472e-9914-040ed0e59d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-214277165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8407f9a-f689-40a9-a962-260bb04bf56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea58c383-7bfd-4016-86ca-19790adf5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea58c383-7bfd-4016-86ca-19790adf5a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b90d828-e777-431d-a38e-c042778915ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b90d828-e777-431d-a38e-c042778915ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8407f9a-f689-40a9-a962-260bb04bf56e', 'volume_name': 'volume-a8407f9a-f689-40a9-a962-260bb04bf56e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ecad1c-634c-44fb-8450-3803c5eb321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ecad1c-634c-44fb-8450-3803c5eb321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2199b2-94c6-4c68-9938-8cb4bdb34f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume a8407f9a-f689-40a9-a962-260bb04bf56e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8407f9a-f689-40a9-a962-260bb04bf56e', 'volume_size': 1} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:23 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a 1073741824" returned: 0 in 0.522s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:23 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a Nov 06 21:28:23 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (d4ee108a-0d3e-497b-8b56-563f749fbb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443c49bf-c749-4283-88e1-03aee0adff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443c49bf-c749-4283-88e1-03aee0adff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706196390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de3928-4324-466a-99a0-590879309a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:24Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7327cd0-765d-4fcf-8411-0ee4cbad4363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7327cd0-765d-4fcf-8411-0ee4cbad4363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982f35f0-c65f-48a1-bcb6-6954d585b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982f35f0-c65f-48a1-bcb6-6954d585b43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70de3928-4324-466a-99a0-590879309a26', 'volume_name': 'volume-70de3928-4324-466a-99a0-590879309a26', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88412bb-20e4-4eb4-b29f-d161938dbe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88412bb-20e4-4eb4-b29f-d161938dbe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6efcf70-4727-4621-a4b7-ec254684c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Volume 70de3928-4324-466a-99a0-590879309a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70de3928-4324-466a-99a0-590879309a26', 'volume_size': 1} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:23 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-214277165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8407f9a-f689-40a9-a962-260bb04bf56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:23Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Creating volume a8407f9a-f689-40a9-a962-260bb04bf56e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:23 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433480ad-de37-4e95-a953-2f003608480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e 1073741824 Nov 06 21:28:23 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7283873c-9c88-4e04-a20a-206f318ea109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a (e2422e94-3db1-4f0b-a71e-f25aa0d1c15a): created successfully Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7283873c-9c88-4e04-a20a-206f318ea109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (0d816076-38e4-4c49-93c6-6ad08b63868d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6c9749db-d98c-4d08-a8d4-5759c4cf34e9 tempest-CreateVolumesFromImageTest-1664507577 None] Created volume successfully. Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (df5e9e15-a5d0-4df9-b3cc-c85273bddbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03156c5-46fe-4ece-aac6-20387d915ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03156c5-46fe-4ece-aac6-20387d915ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248930157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa57aa3-81c5-408b-8bb6-522804165355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:24Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e8526d-fbad-4c46-963b-cd1a5cb9fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e8526d-fbad-4c46-963b-cd1a5cb9fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be718c-39a6-478e-8f49-f08cdc539476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be718c-39a6-478e-8f49-f08cdc539476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa57aa3-81c5-408b-8bb6-522804165355', 'volume_name': 'volume-daa57aa3-81c5-408b-8bb6-522804165355', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222a70bd-cc71-4c6e-a108-c83eb66533a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222a70bd-cc71-4c6e-a108-c83eb66533a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58b7f1-d0c6-405f-a0a5-687433f1e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Volume daa57aa3-81c5-408b-8bb6-522804165355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa57aa3-81c5-408b-8bb6-522804165355', 'volume_size': 1} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:24 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e 1073741824" returned: 0 in 0.570s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:24 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e Nov 06 21:28:24 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:24 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e" returned: 0 in 0.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706196390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de3928-4324-466a-99a0-590879309a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:24Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Creating volume 70de3928-4324-466a-99a0-590879309a26 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:24 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 1073741824 Nov 06 21:28:24 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2199b2-94c6-4c68-9938-8cb4bdb34f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8407f9a-f689-40a9-a962-260bb04bf56e', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7deefcb-121b-4133-8c7e-5ec49e60a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Volume volume-a8407f9a-f689-40a9-a962-260bb04bf56e (a8407f9a-f689-40a9-a962-260bb04bf56e): created successfully Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7deefcb-121b-4133-8c7e-5ec49e60a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (4025439d-be17-417f-9d19-51fa7653de4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (4c0cb73d-9109-4784-b6fe-2555fc95b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7624db18-9cbc-4366-b475-3bf298c5ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7624db18-9cbc-4366-b475-3bf298c5ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236900220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fb63fb-390d-41cc-877c-718f28a61965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:25Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8267ea-5f78-4fc5-80e3-08bb75ab86a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8267ea-5f78-4fc5-80e3-08bb75ab86a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ac5373-cc71-4553-9e0a-9d69975ce6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ac5373-cc71-4553-9e0a-9d69975ce6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fb63fb-390d-41cc-877c-718f28a61965', 'volume_name': 'volume-79fb63fb-390d-41cc-877c-718f28a61965', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a384d63c-a6e1-4169-b729-6e45aaff3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a384d63c-a6e1-4169-b729-6e45aaff3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b7022d-e9ae-4f86-b021-27c0cd9e7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Volume 79fb63fb-390d-41cc-877c-718f28a61965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fb63fb-390d-41cc-877c-718f28a61965', 'volume_size': 1} Nov 06 21:28:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8138f6f4-24c2-4c8c-aed8-3e8e4cd846c9 tempest-CreateVolumesFromImageTest-1664507577 None] Created volume successfully. Nov 06 21:28:25 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 1073741824" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:25 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 Nov 06 21:28:25 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:25 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248930157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa57aa3-81c5-408b-8bb6-522804165355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:24Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Creating volume daa57aa3-81c5-408b-8bb6-522804165355 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6efcf70-4727-4621-a4b7-ec254684c961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70de3928-4324-466a-99a0-590879309a26', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 1073741824 Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6adc8b-4bff-4986-83f0-141dd93a4733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:25 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Volume volume-70de3928-4324-466a-99a0-590879309a26 (70de3928-4324-466a-99a0-590879309a26): created successfully Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6adc8b-4bff-4986-83f0-141dd93a4733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (d4ee108a-0d3e-497b-8b56-563f749fbb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3bb91790-6da4-423c-a3dd-78ff4d8dc459 tempest-CreateVolumesFromImageTest-1664507577 None] Created volume successfully. Nov 06 21:28:25 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 1073741824" returned: 0 in 0.498s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 Nov 06 21:28:26 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355" returned: 0 in 0.256s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.446s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58b7f1-d0c6-405f-a0a5-687433f1e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa57aa3-81c5-408b-8bb6-522804165355', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6f8187-c4a1-4702-88b3-460fb33c447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Creating offline snapshot a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 of volume 6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Volume volume-daa57aa3-81c5-408b-8bb6-522804165355 (daa57aa3-81c5-408b-8bb6-522804165355): created successfully Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6f8187-c4a1-4702-88b3-460fb33c447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (df5e9e15-a5d0-4df9-b3cc-c85273bddbc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71334e-4184-42aa-ba5a-992c84298f0e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e789d2d9-2e89-43b7-8089-c56305126268 tempest-CreateVolumesFromImageTest-1664507577 None] Created volume successfully. Nov 06 21:28:26 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb Nov 06 21:28:26 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:26 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:26 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 1G Nov 06 21:28:26 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:27 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 1G" returned: 0 in 0.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:27 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 Nov 06 21:28:27 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:27 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" returned: 0 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:27 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 is being set with open permissions: ugo+rw Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:27 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 Nov 06 21:28:27 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:27 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:27 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info Nov 06 21:28:27 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info" returned: 0 in 0.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info is being set with open permissions: ugo+rw Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info Nov 06 21:28:28 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.info" returned: 0 in 0.240s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.420s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1236900220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fb63fb-390d-41cc-877c-718f28a61965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd573e525b494e74818b2565ffd744b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:25Z,use_quota=True,user_id='88d28d3393b94af4a2533455c7322dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Creating volume 79fb63fb-390d-41cc-877c-718f28a61965 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:28 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 1073741824 Nov 06 21:28:28 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3deb6126-7684-401d-b30f-5276631e99cf tempest-VolumesSnapshotTestJSON-512655639 None] Create snapshot completed successfully Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:28 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 1073741824" returned: 0 in 0.473s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:28 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 Nov 06 21:28:28 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Deleting offline snapshot a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 of volume 6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] snapshot_file for this snap is: volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80a40f-e8e4-4345-b8c6-34bae5c65412]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:29 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 Nov 06 21:28:29 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:29 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b7022d-e9ae-4f86-b021-27c0cd9e7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fb63fb-390d-41cc-877c-718f28a61965', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a51de3-7716-4e66-bc09-029c8ee7dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Volume volume-79fb63fb-390d-41cc-877c-718f28a61965 (79fb63fb-390d-41cc-877c-718f28a61965): created successfully Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a51de3-7716-4e66-bc09-029c8ee7dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Flow 'volume_create_manager' (4c0cb73d-9109-4784-b6fe-2555fc95b95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-91eeef51-18d8-42db-9bc0-d4e0445da68a tempest-CreateVolumesFromImageTest-1664507577 None] Created volume successfully. Nov 06 21:28:29 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" returned: 0 in 0.389s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc313516-3b91-497b-9fe9-8442a370cba6]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:29 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb Nov 06 21:28:29 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:29 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:29 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 Nov 06 21:28:29 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:30 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" returned: 0 in 0.347s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:30 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1 Nov 06 21:28:30 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-79fb63fb-390d-41cc-877c-718f28a61965-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-79fb63fb-390d-41cc-877c-718f28a61965-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-quobyte-79fb63fb-390d-41cc-877c-718f28a61965" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-79fb63fb-390d-41cc-877c-718f28a61965" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2cd77-af9f-4d9c-ade6-33b83729e2d8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:30 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb.a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1" released by "_delete_snapshot" :: held 1.505s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" released by "delete_snapshot" :: held 1.534s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:30 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 Nov 06 21:28:30 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['75e90891-7a73-4c2c-8163-9a6c4f6e86db', '3f64480d-4298-4677-ba6c-e9ce291fb47d', '93935cc4-7092-44ab-81a1-43833d9ce4a3', '5aed4faf-7142-4e71-8b54-05b25472e1a4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Delete snapshot completed successfully. Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c5145eab-8233-4b8a-a945-fab2e26efa4f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-a0031ce7-30b7-451c-9d7b-80ecdd3e4cd1-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:30 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:30 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965 Nov 06 21:28:30 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-79fb63fb-390d-41cc-877c-718f28a61965" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-79fb63fb-390d-41cc-877c-718f28a61965" released by "delete_volume" :: held 0.775s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Created reservations ['7b1bf72d-c159-4ec2-b707-ee83f47b9ec5', 'fca954cd-f47a-4b24-ab56-6eca56e89544', '61de0779-ecc7-4940-96cc-0c2c5613b070', 'd442dc44-427b-43a9-8c69-78dd7f6041b7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:31 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-daa57aa3-81c5-408b-8bb6-522804165355-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-daa57aa3-81c5-408b-8bb6-522804165355-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-quobyte-daa57aa3-81c5-408b-8bb6-522804165355" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-daa57aa3-81c5-408b-8bb6-522804165355" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d62142-aea9-4ab9-bc47-af067291d92c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.397s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Deleted volume successfully. Nov 06 21:28:31 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 Nov 06 21:28:31 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96d5b168-bd10-4061-b56e-99e558720bf6 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-79fb63fb-390d-41cc-877c-718f28a61965-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (12ce0e22-63d7-4ed2-90ce-29187d4f793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec7f80c-986a-4a61-b0e5-af9c6b5c385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec7f80c-986a-4a61-b0e5-af9c6b5c385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-802407272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eedfea-cf9b-4776-bc4c-949601763f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:32Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098fa671-24ed-41d2-9465-2bf6bff62e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098fa671-24ed-41d2-9465-2bf6bff62e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537d8a23-1ddb-40ef-aa58-a851a36b5453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537d8a23-1ddb-40ef-aa58-a851a36b5453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eedfea-cf9b-4776-bc4c-949601763f4b', 'volume_name': 'volume-d8eedfea-cf9b-4776-bc4c-949601763f4b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f40752-6443-4527-bb19-44367eb351cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f40752-6443-4527-bb19-44367eb351cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e0bc56-9b4d-4050-a6c9-51f605bf91b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Volume d8eedfea-cf9b-4776-bc4c-949601763f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eedfea-cf9b-4776-bc4c-949601763f4b', 'volume_size': 1} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-802407272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eedfea-cf9b-4776-bc4c-949601763f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:32Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Creating volume d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b 1073741824 Nov 06 21:28:31 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-46557b59-f0e1-4c1d-8546-3ab28b860b69 req-a426b2a0-b841-499a-ab63-5cbcd074e959 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:31 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355" returned: 0 in 0.432s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:31 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355 Nov 06 21:28:31 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:32 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-daa57aa3-81c5-408b-8bb6-522804165355" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-daa57aa3-81c5-408b-8bb6-522804165355" released by "delete_volume" :: held 0.805s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:32 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b 1073741824" returned: 0 in 0.443s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:32 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:32 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Created reservations ['0c543d4d-b6d6-4a70-87b0-1f970559f73b', 'f6baa34e-8d99-4964-88de-f97ae173f9ad', '0c1eb064-5b90-4a40-80dd-96f0517e2866', '5676f583-8137-46dd-912c-ab423b6b7f83'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:32 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:32 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:32 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.290s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-46557b59-f0e1-4c1d-8546-3ab28b860b69 req-a426b2a0-b841-499a-ab63-5cbcd074e959 tempest-TestStampPattern-134097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.746s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-70de3928-4324-466a-99a0-590879309a26-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e0bc56-9b4d-4050-a6c9-51f605bf91b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eedfea-cf9b-4776-bc4c-949601763f4b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b564fa7-806b-420f-8060-35aa76496c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-46557b59-f0e1-4c1d-8546-3ab28b860b69 req-a426b2a0-b841-499a-ab63-5cbcd074e959 tempest-TestStampPattern-134097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-70de3928-4324-466a-99a0-590879309a26-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Volume volume-d8eedfea-cf9b-4776-bc4c-949601763f4b (d8eedfea-cf9b-4776-bc4c-949601763f4b): created successfully Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b564fa7-806b-420f-8060-35aa76496c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (12ce0e22-63d7-4ed2-90ce-29187d4f793b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:32 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.310s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f5a0c96a-1888-4105-9f93-7d08d1cd873b tempest-VolumesSnapshotTestJSON-512655639 None] Created volume successfully. Nov 06 21:28:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Deleted volume successfully. Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-46557b59-f0e1-4c1d-8546-3ab28b860b69 req-a426b2a0-b841-499a-ab63-5cbcd074e959 tempest-TestStampPattern-134097027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0058f58e-7fd1-44b9-aa06-0ea9c3199c1c', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-quobyte-70de3928-4324-466a-99a0-590879309a26" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-70de3928-4324-466a-99a0-590879309a26" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5dd2c4e0-3588-4fcc-b0b3-322ce1e71f80 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-daa57aa3-81c5-408b-8bb6-522804165355-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9508f3-4cf2-4654-8ae5-5c75e6256d5a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-46557b59-f0e1-4c1d-8546-3ab28b860b69 req-a426b2a0-b841-499a-ab63-5cbcd074e959 tempest-TestStampPattern-134097027 None] attachment_update completed successfully. Nov 06 21:28:33 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 Nov 06 21:28:33 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:33 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26" returned: 0 in 0.406s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:33 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26 Nov 06 21:28:33 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:33 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-70de3928-4324-466a-99a0-590879309a26" returned: 0 in 0.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-70de3928-4324-466a-99a0-590879309a26" released by "delete_volume" :: held 0.762s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Created reservations ['4d3ef279-06a8-4e05-a240-54fd81b547ea', '4c181e08-7e6e-4f64-a08c-3bf9e9e1418b', '2ac2797a-2174-4a55-8a62-fc0a02c4c466', 'a2b914c7-3ebe-42b5-b655-c805a549efe3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:33 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:33 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-a8407f9a-f689-40a9-a962-260bb04bf56e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-a8407f9a-f689-40a9-a962-260bb04bf56e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-quobyte-a8407f9a-f689-40a9-a962-260bb04bf56e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-a8407f9a-f689-40a9-a962-260bb04bf56e" acquired by "delete_volume" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3412968e-1dc7-4bfa-ab4e-89e5fb41fb09]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Creating offline snapshot ca1148f6-1ef2-4021-8df4-b3b704fc4d1f of volume d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:34 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Deleted volume successfully. Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03c753-ac1a-47bf-b0cc-b97e7c67977c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e Nov 06 21:28:34 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00507e61-b8db-450c-9f4f-b4c174d17253 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-70de3928-4324-466a-99a0-590879309a26-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:34 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:34 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:34 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e" returned: 0 in 0.402s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e Nov 06 21:28:34 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:34 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.393s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f 1G Nov 06 21:28:34 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:34 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a8407f9a-f689-40a9-a962-260bb04bf56e" returned: 0 in 0.287s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-a8407f9a-f689-40a9-a962-260bb04bf56e" released by "delete_volume" :: held 0.758s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Created reservations ['3df2554a-bc08-4a72-8099-306e96cd9099', '28822e7a-9bbe-404a-81f1-d74697e661bb', '9d622a41-59b1-432e-bd07-92674bdd4746', '2592d791-769b-4f2b-afde-0820c18965c0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:34 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f 1G" returned: 0 in 0.576s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eedfea-cf9b-4776-bc4c-949601763f4b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:35 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eedfea-cf9b-4776-bc4c-949601763f4b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:35 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.298s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Deleted volume successfully. Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "cinder-quobyte-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e88b8bc1-98d4-4ea1-9857-0ae27cf2f139 tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-a8407f9a-f689-40a9-a962-260bb04bf56e-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b4ecc6-4983-4417-ab86-f42e7a1fb196]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a Nov 06 21:28:35 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eedfea-cf9b-4776-bc4c-949601763f4b -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f is being set with open permissions: ugo+rw Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:35 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a Nov 06 21:28:35 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.301s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info Nov 06 21:28:35 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-quobyte-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a" released by "delete_volume" :: held 0.773s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Created reservations ['a9ad92a0-3efe-4b19-81a3-f1a96f68e5a8', 'c13341a8-9819-4736-8bda-7301c32329ff', '9df2827d-3d4f-4a90-b328-53aff7767cba', 'b7480b71-f8d2-407d-a58f-e5713d9ad123'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:36 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info" returned: 0 in 0.312s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:36 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info is being set with open permissions: ugo+rw Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:36 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info Nov 06 21:28:36 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:36 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:36 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:36 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.info" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-97fe0d02-9c43-40dc-9a98-ed7f3c26ba6a tempest-VolumesSnapshotTestJSON-512655639 None] Create snapshot completed successfully Nov 06 21:28:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Deleted volume successfully. Nov 06 21:28:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56438f79-ca3c-47f9-ad57-1ca9d0b630bd tempest-CreateVolumesFromImageTest-1664507577 None] Lock "cinder-e2422e94-3db1-4f0b-a71e-f25aa0d1c15a-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:37 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (0fd338c0-ca4d-4d03-9a7b-f4fc725d80f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ff2260-37c4-4203-be3f-013719007a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ff2260-37c4-4203-be3f-013719007a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-642262898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9b873e-63c2-41ab-a7f4-41a678f2b02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ca1148f6-1ef2-4021-8df4-b3b704fc4d1f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:38Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79037c7c-81a7-45b0-96fb-1d02dbb57102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79037c7c-81a7-45b0-96fb-1d02dbb57102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34af80-9a28-457d-a6f7-49e0e1da6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a34af80-9a28-457d-a6f7-49e0e1da6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b9b873e-63c2-41ab-a7f4-41a678f2b02a', 'volume_name': 'volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a', 'volume_size': 2, 'snapshot_id': 'ca1148f6-1ef2-4021-8df4-b3b704fc4d1f'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a419118-e611-4779-8489-0697b89dc7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a419118-e611-4779-8489-0697b89dc7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d50667-d6ba-4189-97b9-dcde1b1662d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Volume 6b9b873e-63c2-41ab-a7f4-41a678f2b02a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a', 'volume_size': 2, 'snapshot_id': 'ca1148f6-1ef2-4021-8df4-b3b704fc4d1f'} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Creating volume 6b9b873e-63c2-41ab-a7f4-41a678f2b02a from snapshot ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] snapshot: ca1148f6-1ef2-4021-8df4-b3b704fc4d1f, volume: 6b9b873e-63c2-41ab-a7f4-41a678f2b02a, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:28:38 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:38 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4370c42-4ff7-4913-b2a8-2cd39732eed0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:38 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:38 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:38 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:28:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-b6b30a6c-38e3-4cd9-a58f-4bf4efc5415f req-acd62c30-3365-45ca-ba15-255853768374 tempest-TestStampPattern-134097027 None] Terminate volume connection completed successfully. Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-b6b30a6c-38e3-4cd9-a58f-4bf4efc5415f req-acd62c30-3365-45ca-ba15-255853768374 tempest-TestStampPattern-134097027 None] Deleting attachment 0058f58e-7fd1-44b9-aa06-0ea9c3199c1c. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:28:38 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.490s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eedfea-cf9b-4776-bc4c-949601763f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ec1dd-cb3e-4b3b-9753-7ed8ab520ffa]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:38 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:38 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.395s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:39 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a Nov 06 21:28:39 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (95e9a967-85b0-4d55-ac63-eefc8192fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23830f68-4e79-40b2-bb52-2c19114cb64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23830f68-4e79-40b2-bb52-2c19114cb64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742790497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62ff329-9351-4945-bd35-8b8d15557d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:40Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45ebf9f-5687-4c39-80e0-515cd73a97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45ebf9f-5687-4c39-80e0-515cd73a97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419f18c0-fd61-4e82-89bd-0bd8e0ff74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419f18c0-fd61-4e82-89bd-0bd8e0ff74f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62ff329-9351-4945-bd35-8b8d15557d89', 'volume_name': 'volume-f62ff329-9351-4945-bd35-8b8d15557d89', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4db14d-d36b-4dc1-889e-6c401ef7f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4db14d-d36b-4dc1-889e-6c401ef7f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db01f762-061b-466a-9df3-061e4ca1bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume f62ff329-9351-4945-bd35-8b8d15557d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62ff329-9351-4945-bd35-8b8d15557d89', 'volume_size': 1} Nov 06 21:28:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:45 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" returned: 0 in 6.040s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:28:45 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Converted 1024.00 MB image at 169.51 MB/s Nov 06 21:28:45 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a is being set with open permissions: ugo+rw Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:45 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a Nov 06 21:28:45 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:45 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" returned: 0 in 0.230s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" released by "_copy_volume_from_snapshot" :: held 7.279s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" released by "_create_volume_from_snapshot" :: held 7.367s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.384s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Creating offline snapshot 82a56df9-6376-4bb9-9ae5-80fdd7b513fe of volume 1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d50667-d6ba-4189-97b9-dcde1b1662d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a', 'volume_size': 2, 'snapshot_id': 'ca1148f6-1ef2-4021-8df4-b3b704fc4d1f'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c05f1-4028-4f3b-b9e5-6ed998c00f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce471f7-7e79-4cdb-93c5-cbb12a3c9173]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Volume volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a (6b9b873e-63c2-41ab-a7f4-41a678f2b02a): created successfully Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c05f1-4028-4f3b-b9e5-6ed998c00f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (0fd338c0-ca4d-4d03-9a7b-f4fc725d80f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fc862e8f-10b5-4dee-9692-aaf1d70d42ce tempest-VolumesSnapshotTestJSON-512655639 None] Created volume successfully. Nov 06 21:28:45 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:28:45 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:45 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.372s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:45 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe 1G Nov 06 21:28:45 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe 1G" returned: 0 in 0.401s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:28:46 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.303s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:46 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe is being set with open permissions: ugo+rw Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:28:46 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-6b9b873e-63c2-41ab-a7f4-41a678f2b02a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-6b9b873e-63c2-41ab-a7f4-41a678f2b02a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9795ecae-02c6-47dc-a8e4-82b26dfb7867]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:46 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a Nov 06 21:28:46 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:46 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info Nov 06 21:28:46 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" returned: 0 in 0.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info is being set with open permissions: ugo+rw Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:47 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a Nov 06 21:28:47 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info Nov 06 21:28:47 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" returned: 0 in 0.239s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6b9b873e-63c2-41ab-a7f4-41a678f2b02a" released by "delete_volume" :: held 0.651s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:47 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.info" returned: 0 in 0.250s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.109s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742790497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62ff329-9351-4945-bd35-8b8d15557d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:40Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:47 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:47 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 1073741824 Nov 06 21:28:47 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b25e5157-8317-4709-91da-4f8dc3a40893 tempest-TestStampPattern-134097027 None] Create snapshot completed successfully Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['c132fa00-578b-4551-ad15-52e5571efacc', '711ff0be-2c8c-4ad5-8c8b-5364a291a2d7', 'f9f29559-17c4-46f4-9a10-4fc4eb0e551f', '0f3fa635-2658-4c5d-b5c9-29caf58c6e78'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:47 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:47 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:47 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.275s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:47 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Deleted volume successfully. Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92d93f29-3244-4488-a45e-37df5279863b tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-6b9b873e-63c2-41ab-a7f4-41a678f2b02a-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:47 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 1073741824" returned: 0 in 0.505s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Deleting offline snapshot ca1148f6-1ef2-4021-8df4-b3b704fc4d1f of volume d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] snapshot_file for this snap is: volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[351cab45-0642-4042-a1ac-6c049c1befa1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:48 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 Nov 06 21:28:48 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:48 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:48 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:48 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db01f762-061b-466a-9df3-061e4ca1bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62ff329-9351-4945-bd35-8b8d15557d89', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03b8b1-5278-4416-b3fb-31590d64dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-f62ff329-9351-4945-bd35-8b8d15557d89 (f62ff329-9351-4945-bd35-8b8d15557d89): created successfully Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe03b8b1-5278-4416-b3fb-31590d64dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (95e9a967-85b0-4d55-ac63-eefc8192fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-913c6b19-595b-4220-94ff-9a8be6dbcdc3 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:28:48 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.428s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eedfea-cf9b-4776-bc4c-949601763f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9356157c-9ea4-4ba2-950c-7eb1ed756653]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:48 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:48 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating offline snapshot 4d2331d1-65f9-4544-bbe5-7294e0d70a42 of volume f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2713853d-04fb-41a6-98a9-78f9d0b6d948]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:48 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 Nov 06 21:28:48 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:49 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.627s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:49 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:49 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:49 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89" returned: 0 in 0.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:49 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 1G Nov 06 21:28:49 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:49 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:49 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f Nov 06 21:28:49 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:49 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 1G" returned: 0 in 0.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62ff329-9351-4945-bd35-8b8d15557d89 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:49 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62ff329-9351-4945-bd35-8b8d15557d89 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 Nov 06 21:28:49 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:49 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b.ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f" released by "_delete_snapshot" :: held 1.885s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" released by "delete_snapshot" :: held 1.919s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['d1b8aa8d-2d2d-49cf-99dc-1375563bfde2', '6cd0675f-f692-44a4-a8a4-4717b433e20a', '136fa39e-14bd-4097-910e-849880c4f4e5', 'f9cc9a3f-77ca-4a7b-ac7b-1abbd1076972'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Delete snapshot completed successfully. Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-730455c1-26c7-4963-9d74-9630ab32cec8 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-ca1148f6-1ef2-4021-8df4-b3b704fc4d1f-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:50 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62ff329-9351-4945-bd35-8b8d15557d89 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 is being set with open permissions: ugo+rw Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:50 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 Nov 06 21:28:50 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-d8eedfea-cf9b-4776-bc4c-949601763f4b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-d8eedfea-cf9b-4776-bc4c-949601763f4b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cebe1b6-9e53-4a3f-a4e5-4d5a60489ef9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:50 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42" returned: 0 in 0.291s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:50 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info Nov 06 21:28:50 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:50 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:50 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:50 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:50 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info is being set with open permissions: ugo+rw Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:50 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info Nov 06 21:28:50 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:50 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.384s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:50 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b Nov 06 21:28:50 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:51 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.info" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:51 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d8eedfea-cf9b-4776-bc4c-949601763f4b" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d8eedfea-cf9b-4776-bc4c-949601763f4b" released by "delete_volume" :: held 0.741s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ac20ed48-f6c0-4a5f-bd70-22d422c0d60a tempest-CreateVolumesFromSnapshotTest-1465533852 None] Create snapshot completed successfully Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['abf1a689-6eb0-4873-9a0e-3748749cae81', '72fe55d7-6deb-4e7c-a719-f9c5c2b9fdfb', '88bb6631-e4fc-4eb4-a52e-57ca9c0cf256', '3a5be4f2-d19f-4670-b652-11956e69aa64'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:51 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:28:51 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:51 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:51 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Deleted volume successfully. Nov 06 21:28:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-96124988-1a01-497b-9ca1-f6a159f984ef tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-d8eedfea-cf9b-4776-bc4c-949601763f4b-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (11239783-c9ba-40be-943b-0b7bcb56cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30450567-64fc-47e1-8134-7a2e6c63faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30450567-64fc-47e1-8134-7a2e6c63faf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1167930948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f256e97d-fa06-4e89-8ee8-fa079c0ab054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:52Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0eb32f-de92-4f7b-986d-3c538dbd3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0eb32f-de92-4f7b-986d-3c538dbd3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9bbccf-b758-4774-9486-4809da034447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9bbccf-b758-4774-9486-4809da034447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f256e97d-fa06-4e89-8ee8-fa079c0ab054', 'volume_name': 'volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed3447e-c8b5-4f46-973e-f17df8e07b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed3447e-c8b5-4f46-973e-f17df8e07b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b12322-16f5-4405-9f6b-f511ebe029b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Volume f256e97d-fa06-4e89-8ee8-fa079c0ab054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054', 'volume_size': 1} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1167930948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f256e97d-fa06-4e89-8ee8-fa079c0ab054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:52Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Creating volume f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:52 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:52 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 1073741824 Nov 06 21:28:52 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (9d4e8bb5-b5b4-4a97-b9f1-517fdd322d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833a6f83-dbd4-48c8-9b3b-79d930ad8500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833a6f83-dbd4-48c8-9b3b-79d930ad8500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987517143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a96924d-2292-4e50-a9a3-fe2652270857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:52Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd6b5cb-8faa-4463-871b-716a0bdcdbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd6b5cb-8faa-4463-871b-716a0bdcdbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5e0cfd-d9a2-430a-89f9-d1f055a199b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5e0cfd-d9a2-430a-89f9-d1f055a199b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a96924d-2292-4e50-a9a3-fe2652270857', 'volume_name': 'volume-1a96924d-2292-4e50-a9a3-fe2652270857', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f28beb-b00f-4a66-90c0-9b083586ce6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f28beb-b00f-4a66-90c0-9b083586ce6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578c692-ce49-428d-83dd-2d5505c45045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume 1a96924d-2292-4e50-a9a3-fe2652270857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a96924d-2292-4e50-a9a3-fe2652270857', 'volume_size': 1} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:52 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 1073741824" returned: 0 in 0.603s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:52 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:28:52 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (62fb0f2e-0b36-4f24-8431-2e1a529bd01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce8b14-7553-4155-9cf6-daef45613c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce8b14-7553-4155-9cf6-daef45613c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902426298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61bb22b-ed64-4070-bb5f-ba2e885b40d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:53Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030cd0d8-d560-4533-94c4-b7faed34c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030cd0d8-d560-4533-94c4-b7faed34c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01856d82-4d4f-41c9-9fea-6d4afe79f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01856d82-4d4f-41c9-9fea-6d4afe79f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61bb22b-ed64-4070-bb5f-ba2e885b40d8', 'volume_name': 'volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f9d529-189a-45f5-bee9-7774fee8289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f9d529-189a-45f5-bee9-7774fee8289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7037bcf-59f7-4c1f-be90-c94687cac10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume f61bb22b-ed64-4070-bb5f-ba2e885b40d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8', 'volume_size': 1} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.340s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987517143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a96924d-2292-4e50-a9a3-fe2652270857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:52Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume 1a96924d-2292-4e50-a9a3-fe2652270857 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b12322-16f5-4405-9f6b-f511ebe029b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d0012a-2cd0-4ec3-909a-c35f1aba6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 1073741824 Nov 06 21:28:53 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Volume volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 (f256e97d-fa06-4e89-8ee8-fa079c0ab054): created successfully Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d0012a-2cd0-4ec3-909a-c35f1aba6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (11239783-c9ba-40be-943b-0b7bcb56cb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6b7c4a42-0654-475a-ab63-aac7550078f5 tempest-VolumesSnapshotTestJSON-512655639 None] Created volume successfully. Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (cba833ee-32f4-4659-bf83-b1dc2dcfad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d1fe8-3998-47aa-952c-17863dcacae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d1fe8-3998-47aa-952c-17863dcacae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908448954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6811fa6d-4197-4c89-992b-b5c23f37dcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46f0912-cb0c-4b9b-9ae6-2f13f5de5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46f0912-cb0c-4b9b-9ae6-2f13f5de5548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eb2145-4a6f-4e92-ab74-8c4aa2d051d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eb2145-4a6f-4e92-ab74-8c4aa2d051d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6811fa6d-4197-4c89-992b-b5c23f37dcf5', 'volume_name': 'volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffcb2ea-59c6-45bf-bb8b-abd77678d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffcb2ea-59c6-45bf-bb8b-abd77678d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df666c11-378b-4b0a-b83e-2704be260230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume 6811fa6d-4197-4c89-992b-b5c23f37dcf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5', 'volume_size': 1} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:53 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 1073741824" returned: 0 in 0.722s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:54 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 Nov 06 21:28:54 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (57d95edc-14b3-4c5e-b617-91f2e4fd6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5660333-fcf3-4870-871f-57a6278f90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5660333-fcf3-4870-871f-57a6278f90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212533962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f4371-3f54-47cd-ac78-f6b68c30bbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e11e6f-1b16-4e12-8dc7-c1b54551c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e11e6f-1b16-4e12-8dc7-c1b54551c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf75830-241b-42ba-bc10-edd3a530bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf75830-241b-42ba-bc10-edd3a530bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232f4371-3f54-47cd-ac78-f6b68c30bbe1', 'volume_name': 'volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d575ab-ef50-459c-b75e-49155a3fe270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d575ab-ef50-459c-b75e-49155a3fe270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acf9cd7-80d5-447d-a2a5-a473365a92dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume 232f4371-3f54-47cd-ac78-f6b68c30bbe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1', 'volume_size': 1} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857" returned: 0 in 0.451s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902426298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61bb22b-ed64-4070-bb5f-ba2e885b40d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:53Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume f61bb22b-ed64-4070-bb5f-ba2e885b40d8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:54 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578c692-ce49-428d-83dd-2d5505c45045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a96924d-2292-4e50-a9a3-fe2652270857', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18dc852-8404-4334-917c-d7eb3fe5e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 1073741824 Nov 06 21:28:54 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-1a96924d-2292-4e50-a9a3-fe2652270857 (1a96924d-2292-4e50-a9a3-fe2652270857): created successfully Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18dc852-8404-4334-917c-d7eb3fe5e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (9d4e8bb5-b5b4-4a97-b9f1-517fdd322d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b7c6c45a-9606-473e-8867-4eb9aae16e3e tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (9a6f3c36-126a-4212-bdaa-2079810cc05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cbcf8f-6212-4a19-9022-83e79b8c96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cbcf8f-6212-4a19-9022-83e79b8c96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715153536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbbf506-1aeb-4910-8452-d097bb26d913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:55Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20bbf40-d9fe-4f12-8d8f-92bfebb61393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20bbf40-d9fe-4f12-8d8f-92bfebb61393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f75540c-fe1d-441d-981d-4dd2e2024933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f75540c-fe1d-441d-981d-4dd2e2024933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbbf506-1aeb-4910-8452-d097bb26d913', 'volume_name': 'volume-5bbbf506-1aeb-4910-8452-d097bb26d913', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a66f0d-f097-4720-a878-925058a92be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a66f0d-f097-4720-a878-925058a92be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d132f27f-4ae5-44d2-aa75-1ac9a228a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume 5bbbf506-1aeb-4910-8452-d097bb26d913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbbf506-1aeb-4910-8452-d097bb26d913', 'volume_size': 1} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 1073741824" returned: 0 in 0.479s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:54 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 Nov 06 21:28:54 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:55 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" returned: 0 in 0.234s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-908448954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6811fa6d-4197-4c89-992b-b5c23f37dcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume 6811fa6d-4197-4c89-992b-b5c23f37dcf5 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7037bcf-59f7-4c1f-be90-c94687cac10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17633065-cc60-43e6-be09-edd26fcfb701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:55 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 1073741824 Nov 06 21:28:55 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 (f61bb22b-ed64-4070-bb5f-ba2e885b40d8): created successfully Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17633065-cc60-43e6-be09-edd26fcfb701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (62fb0f2e-0b36-4f24-8431-2e1a529bd01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a8eedf0c-fe53-4139-b418-dcfc06190a02 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:28:55 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 1073741824" returned: 0 in 0.519s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:55 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 Nov 06 21:28:55 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:56 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212533962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f4371-3f54-47cd-ac78-f6b68c30bbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume 232f4371-3f54-47cd-ac78-f6b68c30bbe1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:56 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 1073741824 Nov 06 21:28:56 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df666c11-378b-4b0a-b83e-2704be260230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07e3740-f4c1-4c00-a6db-37d121e43abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 (6811fa6d-4197-4c89-992b-b5c23f37dcf5): created successfully Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07e3740-f4c1-4c00-a6db-37d121e43abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (cba833ee-32f4-4659-bf83-b1dc2dcfad58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Flow 'volume_create_manager' (b0a39813-b9c9-4f93-b27f-203c53e27abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9754e369-366e-4d4f-8b8c-dc72cec71cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-01d3e621-9c70-4a4d-a5d5-24b9429aaa4d tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9754e369-366e-4d4f-8b8c-dc72cec71cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-968031534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b556aac-9fa9-4731-a993-03cb8634aaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ca3d2385264d28b7610f04dd1c987e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82a56df9-6376-4bb9-9ae5-80fdd7b513fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:56Z,use_quota=True,user_id='d69c158928644819ae256e529ef079c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f72f6ae-3246-4392-89c0-7b5f5f597ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f72f6ae-3246-4392-89c0-7b5f5f597ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94112a34-48f3-4790-81b7-94c0eb74e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94112a34-48f3-4790-81b7-94c0eb74e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b556aac-9fa9-4731-a993-03cb8634aaff', 'volume_name': 'volume-6b556aac-9fa9-4731-a993-03cb8634aaff', 'volume_size': 1, 'snapshot_id': '82a56df9-6376-4bb9-9ae5-80fdd7b513fe'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e996ff-281e-44a1-8302-8908fa8e9e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e996ff-281e-44a1-8302-8908fa8e9e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f9ced5-29b5-47ce-a4d9-07f4cff6c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Volume 6b556aac-9fa9-4731-a993-03cb8634aaff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b556aac-9fa9-4731-a993-03cb8634aaff', 'volume_size': 1, 'snapshot_id': '82a56df9-6376-4bb9-9ae5-80fdd7b513fe'} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:56 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 1073741824" returned: 0 in 0.483s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:56 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 Nov 06 21:28:56 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:56 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.122s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acf9cd7-80d5-447d-a2a5-a473365a92dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f8428-69f0-4b1c-a349-f5423c756629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Creating offline snapshot 5698e6bc-9f02-4290-a838-c6ea3d00b383 of volume f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 (232f4371-3f54-47cd-ac78-f6b68c30bbe1): created successfully Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f8428-69f0-4b1c-a349-f5423c756629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (57d95edc-14b3-4c5e-b617-91f2e4fd6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36205ce-2b62-4eed-9052-a18ba30faac6]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1fd8c7c0-582f-4e06-beb3-e3ecc37d6440 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:28:57 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:28:57 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:57 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.408s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:57 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 1G Nov 06 21:28:57 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:57 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 1G" returned: 0 in 0.460s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:57 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:28:57 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:58 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.395s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:58 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 is being set with open permissions: ugo+rw Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:58 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:28:58 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:58 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.268s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:58 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info Nov 06 21:28:58 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:58 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:58 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info is being set with open permissions: ugo+rw Nov 06 21:28:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:58 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info Nov 06 21:28:59 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:59 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.info" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.499s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715153536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbbf506-1aeb-4910-8452-d097bb26d913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd20143883534df498dcf189559393c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:55Z,use_quota=True,user_id='25e32133f2584e018fbeda46129454e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Creating volume 5bbbf506-1aeb-4910-8452-d097bb26d913 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:28:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-08944f78-f610-48ec-831a-f6b116bbf94d tempest-VolumesSnapshotTestJSON-512655639 None] Create snapshot completed successfully Nov 06 21:28:59 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 1073741824 Nov 06 21:28:59 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:00 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 1073741824" returned: 0 in 0.628s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:00 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 Nov 06 21:29:00 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:00 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.224s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-6b556aac-9fa9-4731-a993-03cb8634aaff" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d132f27f-4ae5-44d2-aa75-1ac9a228a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbbf506-1aeb-4910-8452-d097bb26d913', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f999f8-1c3e-4b06-839e-898add5f7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-6b556aac-9fa9-4731-a993-03cb8634aaff" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Creating volume 6b556aac-9fa9-4731-a993-03cb8634aaff from snapshot 82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Volume volume-5bbbf506-1aeb-4910-8452-d097bb26d913 (5bbbf506-1aeb-4910-8452-d097bb26d913): created successfully Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f999f8-1c3e-4b06-839e-898add5f7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Flow 'volume_create_manager' (9a6f3c36-126a-4212-bdaa-2079810cc05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b9898435-f4a2-4bbc-a40b-17f326578cb1 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created volume successfully. Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] snapshot: 82a56df9-6376-4bb9-9ae5-80fdd7b513fe, volume: 6b556aac-9fa9-4731-a993-03cb8634aaff, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (674ed5f9-0dd1-4bfe-9515-204a89930011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1860ef8d-1edf-4187-830b-177a75c211db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b4861a-8b89-44d4-a8c0-a9cde83a0722]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1860ef8d-1edf-4187-830b-177a75c211db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1661086579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e9a523-ae3c-44ce-a702-1aad2520d575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315acb3193844a909d1d90ecfc9b3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5698e6bc-9f02-4290-a838-c6ea3d00b383,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:00Z,use_quota=True,user_id='c82fa42ff60144cfad268b022e0c8051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4014c2-1398-4f6b-99d3-5465e85af7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4014c2-1398-4f6b-99d3-5465e85af7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338d45ae-127c-45a8-8319-6969cc934ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338d45ae-127c-45a8-8319-6969cc934ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5e9a523-ae3c-44ce-a702-1aad2520d575', 'volume_name': 'volume-d5e9a523-ae3c-44ce-a702-1aad2520d575', 'volume_size': 1, 'snapshot_id': '5698e6bc-9f02-4290-a838-c6ea3d00b383'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb7370c-b883-4817-90e5-196ee7ea0542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb7370c-b883-4817-90e5-196ee7ea0542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9fb7e3-0fc6-4404-8f0c-43e8d371d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Volume d5e9a523-ae3c-44ce-a702-1aad2520d575: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5e9a523-ae3c-44ce-a702-1aad2520d575', 'volume_size': 1, 'snapshot_id': '5698e6bc-9f02-4290-a838-c6ea3d00b383'} Nov 06 21:29:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:00 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:29:00 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:01 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe4bd7a-bc0b-4a87-82ee-25b0e7901f76]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-5bbbf506-1aeb-4910-8452-d097bb26d913-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-5bbbf506-1aeb-4910-8452-d097bb26d913-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-5bbbf506-1aeb-4910-8452-d097bb26d913" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:01 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:29:01 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-5bbbf506-1aeb-4910-8452-d097bb26d913" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5b1ff8-a16b-4e1c-9d5b-e6669d0746b1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:01 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 Nov 06 21:29:01 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:02 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.727s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:02 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff Nov 06 21:29:02 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:02 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913" returned: 0 in 0.766s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:02 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913 Nov 06 21:29:02 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:02 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5bbbf506-1aeb-4910-8452-d097bb26d913" returned: 0 in 0.338s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-5bbbf506-1aeb-4910-8452-d097bb26d913" released by "delete_volume" :: held 1.211s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['688eedb6-bf72-412a-85c1-5fafccf1e812', '0ec2e671-1910-47fc-a651-c39a53cc5ea0', 'bfe4cb04-e513-4413-8737-c31d25511014', 'a27c63a9-9850-4c65-abdb-d3b58d574461'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:03 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:03 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:03 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:03 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ebd90d10-7989-4a16-8a99-105c3d938662 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-5bbbf506-1aeb-4910-8452-d097bb26d913-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-232f4371-3f54-47cd-ac78-f6b68c30bbe1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-232f4371-3f54-47cd-ac78-f6b68c30bbe1-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-232f4371-3f54-47cd-ac78-f6b68c30bbe1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-232f4371-3f54-47cd-ac78-f6b68c30bbe1" acquired by "delete_volume" :: waited 0.064s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb267624-58ea-4382-8bbb-2fc44dbd740f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:04 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 Nov 06 21:29:04 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:05 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1" returned: 0 in 0.996s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:05 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1 Nov 06 21:29:05 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:05 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-232f4371-3f54-47cd-ac78-f6b68c30bbe1" returned: 0 in 0.477s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-232f4371-3f54-47cd-ac78-f6b68c30bbe1" released by "delete_volume" :: held 1.606s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:05 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['1c6298ca-7a19-4a1e-b40a-8477d02a5628', 'a87ec9da-1357-4bb8-8438-1a33bdd36236', 'b2ba12a1-353f-47da-891a-5efc1aece23f', '48a081e1-603a-4e96-ad7e-8960e9f6900b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:06 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:06 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-6811fa6d-4197-4c89-992b-b5c23f37dcf5-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-6811fa6d-4197-4c89-992b-b5c23f37dcf5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-6811fa6d-4197-4c89-992b-b5c23f37dcf5" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-6811fa6d-4197-4c89-992b-b5c23f37dcf5" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac8222-ee3b-40e8-8608-af7834e9db30]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:07 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 Nov 06 21:29:07 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:07 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.991s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:07 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15f7bf4b-74f3-484a-af75-a94a1c49ab85 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-232f4371-3f54-47cd-ac78-f6b68c30bbe1-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:07 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5" returned: 0 in 0.815s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:07 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5 Nov 06 21:29:07 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:08 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6811fa6d-4197-4c89-992b-b5c23f37dcf5" returned: 0 in 0.689s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-6811fa6d-4197-4c89-992b-b5c23f37dcf5" released by "delete_volume" :: held 1.656s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['74124508-be42-468b-9ee8-3e82c5df4032', '0a60454b-7641-4c9b-8701-9ab721072616', '4dc388bc-5102-4171-968d-06157efd80ee', '0f994a72-75b8-4841-a588-3c9741d7f99f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:09 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:09 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-f61bb22b-ed64-4070-bb5f-ba2e885b40d8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-f61bb22b-ed64-4070-bb5f-ba2e885b40d8-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" acquired by "delete_volume" :: waited 0.067s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[828aa83a-ba4d-427b-b698-d2ee5b2be18a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:09 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 1.014s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:09 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fb1f3e88-707c-4afc-9549-9cd3dbf15802 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-6811fa6d-4197-4c89-992b-b5c23f37dcf5-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:10 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 Nov 06 21:29:10 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" returned: 0 in 1.215s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:11 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8 Nov 06 21:29:11 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:11 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" returned: 0 in 0.557s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f61bb22b-ed64-4070-bb5f-ba2e885b40d8" released by "delete_volume" :: held 1.910s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=142,cinder:INSERT=38,cinder:UPDATE=152,cinder:DELETE=15 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=159,cinder:SELECT=129,cinder:INSERT=35,cinder:DELETE=16 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['583c1dc2-2cac-4e56-884d-199524c8e8de', '4cf80897-dafb-48f1-8e54-9d1e6a9e14b3', 'f614987b-0664-4191-ab64-8b55aa73dfd6', '1d32dfb5-762a-46ec-b593-2faee8eba0e4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:12 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:12 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-1a96924d-2292-4e50-a9a3-fe2652270857-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-1a96924d-2292-4e50-a9a3-fe2652270857-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-1a96924d-2292-4e50-a9a3-fe2652270857" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-1a96924d-2292-4e50-a9a3-fe2652270857" acquired by "delete_volume" :: waited 0.072s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ebae5b-6c9f-4658-99e1-e8fd8ddd2416]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:12 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.677s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-093a5751-6ec6-4936-ad28-56b03c170f47 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-f61bb22b-ed64-4070-bb5f-ba2e885b40d8-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:13 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 Nov 06 21:29:13 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:13 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857" returned: 0 in 1.022s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:13 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857 Nov 06 21:29:13 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:13 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff" returned: 0 in 11.818s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:13 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31, size 1024.00 MB, duration 11.82 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:13 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Converted 1024.00 MB image at 86.64 MB/s Nov 06 21:29:13 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff is being set with open permissions: ugo+rw Nov 06 21:29:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:13 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff Nov 06 21:29:13 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:14 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:14 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" released by "_copy_volume_from_snapshot" :: held 13.543s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1a96924d-2292-4e50-a9a3-fe2652270857" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-1a96924d-2292-4e50-a9a3-fe2652270857" released by "delete_volume" :: held 1.476s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-6b556aac-9fa9-4731-a993-03cb8634aaff" released by "_create_volume_from_snapshot" :: held 13.690s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.756s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.302s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383-d5e9a523-ae3c-44ce-a702-1aad2520d575" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383-d5e9a523-ae3c-44ce-a702-1aad2520d575" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Creating volume d5e9a523-ae3c-44ce-a702-1aad2520d575 from snapshot 5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f9ced5-29b5-47ce-a4d9-07f4cff6c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b556aac-9fa9-4731-a993-03cb8634aaff', 'volume_size': 1, 'snapshot_id': '82a56df9-6376-4bb9-9ae5-80fdd7b513fe'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b46d69-970a-460d-b834-32743b5a6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] snapshot: 5698e6bc-9f02-4290-a838-c6ea3d00b383, volume: d5e9a523-ae3c-44ce-a702-1aad2520d575, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:29:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Volume volume-6b556aac-9fa9-4731-a993-03cb8634aaff (6b556aac-9fa9-4731-a993-03cb8634aaff): created successfully Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b46d69-970a-460d-b834-32743b5a6301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Flow 'volume_create_manager' (b0a39813-b9c9-4f93-b27f-203c53e27abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['6899c6bb-f697-4c6f-8ab4-142ada75c29e', '03978278-c978-4cc2-aebb-b35f2b46ae9d', '26bc325b-aeb8-452f-89ed-0e790b73f0c6', '1d4fec50-c3b7-4526-8d63-9d816afc8e6d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[775df2f5-1f00-4877-84d4-f25aaed2de68]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-18c85102-507b-475b-9abd-bbe806c2a085 tempest-TestStampPattern-134097027 None] Created volume successfully. Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:14 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:14 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:14 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:29:14 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:14 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9d78d022-db86-481e-a010-face82a9c004 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-1a96924d-2292-4e50-a9a3-fe2652270857-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-4d2331d1-65f9-4544-bbe5-7294e0d70a42-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-4d2331d1-65f9-4544-bbe5-7294e0d70a42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-4d2331d1-65f9-4544-bbe5-7294e0d70a42" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-4d2331d1-65f9-4544-bbe5-7294e0d70a42" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleting offline snapshot 4d2331d1-65f9-4544-bbe5-7294e0d70a42 of volume f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:29:15 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] snapshot_file for this snap is: volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.596s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f2793-26c0-44ca-8c89-7261b90bbb8f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a27c2-5514-4402-bc84-4d4c477b7792]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:15 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 Nov 06 21:29:15 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:15 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:29:15 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:15 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42" returned: 0 in 0.443s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62ff329-9351-4945-bd35-8b8d15557d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:15 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.475s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f590f4-8891-4e81-93fa-7322495d529a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:15 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 Nov 06 21:29:15 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:15 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 Nov 06 21:29:15 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:16 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89" returned: 0 in 0.628s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:16 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 Nov 06 21:29:16 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:17 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42" returned: 0 in 0.989s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:17 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42 Nov 06 21:29:17 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:17 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89.4d2331d1-65f9-4544-bbe5-7294e0d70a42" returned: 0 in 0.368s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-4d2331d1-65f9-4544-bbe5-7294e0d70a42" released by "_delete_snapshot" :: held 2.657s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" released by "delete_snapshot" :: held 2.693s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['dec592f3-b52e-471d-8833-8de67315fb45', 'a966b4f4-d004-4f25-b367-0e81efb455aa', '99143fd8-61b3-4e91-8dea-78d909fa48df', '5a76c249-c146-4e86-b37f-5fadbf69d30c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Delete snapshot completed successfully. Nov 06 21:29:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-15850d35-eda1-4734-a51d-2ff59851ed29 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-4d2331d1-65f9-4544-bbe5-7294e0d70a42-delete_snapshot" released by "delete_snapshot" :: held 2.961s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-f62ff329-9351-4945-bd35-8b8d15557d89-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-f62ff329-9351-4945-bd35-8b8d15557d89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" acquired by "delete_volume" :: waited 0.048s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a42b613-55d2-42c6-ac8b-5a115fb41ed4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:18 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 Nov 06 21:29:18 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:19 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89" returned: 0 in 0.874s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:19 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89 Nov 06 21:29:19 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:19 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f62ff329-9351-4945-bd35-8b8d15557d89" returned: 0 in 0.481s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-quobyte-f62ff329-9351-4945-bd35-8b8d15557d89" released by "delete_volume" :: held 1.535s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Created reservations ['6ac09be9-cf53-4cf8-8f6e-6a4550ef6a5c', '3d5a0fb6-3d6c-47d9-9b7b-2aee4ca87dbc', 'bc9e4f2c-19e1-4ff0-b9b1-d4ec2e3fe237', 'a588068a-40dd-42a1-a1eb-83cfc70d2f77'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:20 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:20 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:20 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.461s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Deleted volume successfully. Nov 06 21:29:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1be634a8-cd5a-4033-84ab-17a7754740c8 tempest-CreateVolumesFromSnapshotTest-1465533852 None] Lock "cinder-f62ff329-9351-4945-bd35-8b8d15557d89-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:23 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575" returned: 0 in 7.853s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:23 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Converted 1024.00 MB image at 130.38 MB/s Nov 06 21:29:23 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 is being set with open permissions: ugo+rw Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:23 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 Nov 06 21:29:23 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:23 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" released by "_copy_volume_from_snapshot" :: held 9.346s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383-d5e9a523-ae3c-44ce-a702-1aad2520d575" released by "_create_volume_from_snapshot" :: held 9.429s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.460s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9fb7e3-0fc6-4404-8f0c-43e8d371d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e9a523-ae3c-44ce-a702-1aad2520d575', 'volume_size': 1, 'snapshot_id': '5698e6bc-9f02-4290-a838-c6ea3d00b383'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fb1281-dd20-4b5c-a6b4-414d168c6e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Volume volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 (d5e9a523-ae3c-44ce-a702-1aad2520d575): created successfully Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fb1281-dd20-4b5c-a6b4-414d168c6e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Flow 'volume_create_manager' (674ed5f9-0dd1-4bfe-9515-204a89930011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9a7b74e4-0b6f-430d-a7b8-a4098cbf81e2 tempest-VolumesSnapshotTestJSON-512655639 None] Created volume successfully. Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-d5e9a523-ae3c-44ce-a702-1aad2520d575-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-d5e9a523-ae3c-44ce-a702-1aad2520d575-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4425699-8138-4848-95da-c71c07126410]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:24 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 Nov 06 21:29:24 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (014e3518-ef84-42d2-9dd8-eca9570c8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eea0ae0-9f40-4754-b86f-4e5e4a2c33d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eea0ae0-9f40-4754-b86f-4e5e4a2c33d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-624070434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91365d15-10a7-4340-860a-cf15028742df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:25Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36471226-ea02-4e5c-a835-949d7188dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36471226-ea02-4e5c-a835-949d7188dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f7831d-ed6c-471a-842e-c7e45aaa3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f7831d-ed6c-471a-842e-c7e45aaa3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91365d15-10a7-4340-860a-cf15028742df', 'volume_name': 'volume-91365d15-10a7-4340-860a-cf15028742df', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c153d1d3-236a-4731-baab-9f9547979dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c153d1d3-236a-4731-baab-9f9547979dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cdd9de-6473-4a88-b47c-b09472114133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume 91365d15-10a7-4340-860a-cf15028742df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91365d15-10a7-4340-860a-cf15028742df', 'volume_size': 1} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-624070434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91365d15-10a7-4340-860a-cf15028742df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:25Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume 91365d15-10a7-4340-860a-cf15028742df {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:24 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df 1073741824 Nov 06 21:29:24 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:25 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575" returned: 0 in 0.391s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:25 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575 Nov 06 21:29:25 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:25 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d5e9a523-ae3c-44ce-a702-1aad2520d575" returned: 0 in 0.289s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-d5e9a523-ae3c-44ce-a702-1aad2520d575" released by "delete_volume" :: held 0.736s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:25 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df 1073741824" returned: 0 in 0.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['5dfae02f-9cb7-419b-ab43-c590c09abbf9', 'f8ccde5a-0b76-42cf-a065-f7a819c0b725', '26f367ad-db3f-4914-88b0-4a8b8574716b', '325f68d7-f4c5-470f-8066-16e813139988'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:25 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df Nov 06 21:29:25 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:25 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:25 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:25 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df" returned: 0 in 0.284s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cdd9de-6473-4a88-b47c-b09472114133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91365d15-10a7-4340-860a-cf15028742df', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b8297e-c694-4caf-9d76-6a716f309612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-5698e6bc-9f02-4290-a838-c6ea3d00b383-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-91365d15-10a7-4340-860a-cf15028742df (91365d15-10a7-4340-860a-cf15028742df): created successfully Nov 06 21:29:25 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b8297e-c694-4caf-9d76-6a716f309612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (014e3518-ef84-42d2-9dd8-eca9570c8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Deleted volume successfully. Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-5698e6bc-9f02-4290-a838-c6ea3d00b383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-04b34007-a373-45e3-8dbb-7f3c7d5a631c tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fa0548ba-b089-4bea-8099-b2b2f86c5606 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-d5e9a523-ae3c-44ce-a702-1aad2520d575-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Deleting offline snapshot 5698e6bc-9f02-4290-a838-c6ea3d00b383 of volume f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] snapshot_file for this snap is: volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0d016-380d-4893-9a55-8eb279a32410]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:29:26 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:26 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.345s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e8332-317c-4328-aabc-246256ae792f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:29:26 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:26 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.526s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:29:26 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:27 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:27 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383 Nov 06 21:29:27 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (a48584e1-dcd0-4178-a714-4061f539c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:27 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beadd59-8580-40bc-a3ea-448bb09e9967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054.5698e6bc-9f02-4290-a838-c6ea3d00b383" returned: 0 in 0.404s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beadd59-8580-40bc-a3ea-448bb09e9967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723064360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:28Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc93e9a-e369-4286-a236-9419ad82cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc93e9a-e369-4286-a236-9419ad82cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f315c36-43ae-4662-a78b-7df49ce15f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f315c36-43ae-4662-a78b-7df49ce15f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea', 'volume_name': 'volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa59e79d-0bca-45e6-8e86-7d9aa3b77f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa59e79d-0bca-45e6-8e86-7d9aa3b77f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8973ff-082b-4c30-b258-78782bfcea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume 1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea', 'volume_size': 1} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723064360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:28Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume 1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:27 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:27 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea 1073741824 Nov 06 21:29:27 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-5698e6bc-9f02-4290-a838-c6ea3d00b383" released by "_delete_snapshot" :: held 1.994s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" released by "delete_snapshot" :: held 2.028s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['77eb8174-4b7a-4569-95e6-9321cb22d575', '02146c0d-65d9-4665-82ae-7dc3992fbbc1', '721362bc-f5eb-4500-a4a1-c68cb4cbd934', '0d92565e-b727-4e95-b6d9-8e64cede01a8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Delete snapshot completed successfully. Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d1b4662d-33d1-46b7-91ba-4aacf080fd9f tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-5698e6bc-9f02-4290-a838-c6ea3d00b383-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (94414572-9c25-4e6a-b2ed-7fb006e49f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c858afb-29cd-4df1-a5a3-da718cd5273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c858afb-29cd-4df1-a5a3-da718cd5273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764620914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8f86b5-ec08-4993-8061-d1a792f49573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:28Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467900e-9aa6-401a-bf85-c62c4fce53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467900e-9aa6-401a-bf85-c62c4fce53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669cc63-6618-43bd-afd9-a333e5ead2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669cc63-6618-43bd-afd9-a333e5ead2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8f86b5-ec08-4993-8061-d1a792f49573', 'volume_name': 'volume-ef8f86b5-ec08-4993-8061-d1a792f49573', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ab01b-4ffe-47d2-99ae-7f09fb132912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058ab01b-4ffe-47d2-99ae-7f09fb132912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87f98d3-e50a-4f6e-8a0b-cc4ee706d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume ef8f86b5-ec08-4993-8061-d1a792f49573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8f86b5-ec08-4993-8061-d1a792f49573', 'volume_size': 1} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:28 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea 1073741824" returned: 0 in 0.721s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:28 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea Nov 06 21:29:28 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (bc7e7f22-4604-46e5-90b1-e33c06686c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbdce8f-ecc8-46d6-92ba-c464ac14b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbdce8f-ecc8-46d6-92ba-c464ac14b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682458156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:29Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f91742-bf25-46a7-b518-21e50b4d2abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f91742-bf25-46a7-b518-21e50b4d2abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96137298-c21c-4f84-96c5-f18f64f94313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96137298-c21c-4f84-96c5-f18f64f94313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2', 'volume_name': 'volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc22edcb-fb59-4a88-80b2-58cb22eb939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc22edcb-fb59-4a88-80b2-58cb22eb939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da836380-9bf3-4462-b738-de936afcc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume 7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2', 'volume_size': 1} Nov 06 21:29:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:29 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" returned: 0 in 0.459s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764620914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8f86b5-ec08-4993-8061-d1a792f49573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:28Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume ef8f86b5-ec08-4993-8061-d1a792f49573 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8973ff-082b-4c30-b258-78782bfcea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c7534-5fdd-453a-8070-d61512faabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 1073741824 Nov 06 21:29:29 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea (1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea): created successfully Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c7534-5fdd-453a-8070-d61512faabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (a48584e1-dcd0-4178-a714-4061f539c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f8ff7439-28f8-4da3-bb73-3314d68ade42 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (a8983269-51e8-46ba-af11-ed75d5cc93ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa046d1-294c-48bd-9511-90fb834fb290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa046d1-294c-48bd-9511-90fb834fb290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531534228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1512e4c6-3fa1-43c7-812b-96e08b1f9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:29Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e3aa9-bd89-4c47-9654-3a8230a2a00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e3aa9-bd89-4c47-9654-3a8230a2a00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd3361d-fe61-4c1f-8792-bd838a782ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd3361d-fe61-4c1f-8792-bd838a782ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1512e4c6-3fa1-43c7-812b-96e08b1f9d94', 'volume_name': 'volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32bcb28-36c2-4737-8d99-19e13f6e881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32bcb28-36c2-4737-8d99-19e13f6e881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa461ccb-e2a5-4cb4-b816-d06ac2dc1d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume 1512e4c6-3fa1-43c7-812b-96e08b1f9d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94', 'volume_size': 1} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-f256e97d-fa06-4e89-8ee8-fa079c0ab054-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-f256e97d-fa06-4e89-8ee8-fa079c0ab054-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b890c108-22b9-4650-8b5b-ed6cd339048b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:29:29 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 1073741824" returned: 0 in 0.688s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 Nov 06 21:29:29 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (0bed7f6e-4587-4d6a-93f3-9a03f16d4279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d8961-bdff-4d41-8056-b1890344f2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d8961-bdff-4d41-8056-b1890344f2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397241536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3704f65-0c17-4152-98f4-2f6283f130b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:30Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5402de-9377-46ee-8381-89323a621e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5402de-9377-46ee-8381-89323a621e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7a46f-7ed9-4e88-9547-aa608e91db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7a46f-7ed9-4e88-9547-aa608e91db2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3704f65-0c17-4152-98f4-2f6283f130b6', 'volume_name': 'volume-f3704f65-0c17-4152-98f4-2f6283f130b6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893b77b-b9c8-4488-b36f-f9bd896dc258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893b77b-b9c8-4488-b36f-f9bd896dc258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7933e269-9e2a-431c-8ac3-d9e5a41ab56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume f3704f65-0c17-4152-98f4-2f6283f130b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3704f65-0c17-4152-98f4-2f6283f130b6', 'volume_size': 1} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.478s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054 Nov 06 21:29:29 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1682458156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:29Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume 7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87f98d3-e50a-4f6e-8a0b-cc4ee706d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8f86b5-ec08-4993-8061-d1a792f49573', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:30 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 1073741824 Nov 06 21:29:30 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf25fd41-0952-4f62-8157-01a2b10f7f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-ef8f86b5-ec08-4993-8061-d1a792f49573 (ef8f86b5-ec08-4993-8061-d1a792f49573): created successfully Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf25fd41-0952-4f62-8157-01a2b10f7f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (94414572-9c25-4e6a-b2ed-7fb006e49f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-70cb9104-f2b8-4546-b5aa-c3caaf10cd63 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:30 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f256e97d-fa06-4e89-8ee8-fa079c0ab054" returned: 0 in 0.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-f256e97d-fa06-4e89-8ee8-fa079c0ab054" released by "delete_volume" :: held 0.834s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['4f775405-1ed0-4ed5-ba49-9999ee634b93', 'e847def3-1f4e-4c3f-a138-a6536a065c7f', 'a83a430c-01ee-4488-8f7c-adcfa182beff', '07a9132f-f80f-4047-8b4c-0a576429a8cf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:30 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 1073741824" returned: 0 in 0.519s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-6617a7e9-d349-443a-8bdc-6ff3b7af64cb-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:30 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.273s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-6617a7e9-d349-443a-8bdc-6ff3b7af64cb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Deleted volume successfully. Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 Nov 06 21:29:30 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cb730277-f8ab-4d33-9080-c8717f91f258 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-f256e97d-fa06-4e89-8ee8-fa079c0ab054-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e017a5-2722-4b09-9337-f64b50126afe]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb Nov 06 21:29:30 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" returned: 0 in 0.293s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531534228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1512e4c6-3fa1-43c7-812b-96e08b1f9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:29Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume 1512e4c6-3fa1-43c7-812b-96e08b1f9d94 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:30 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da836380-9bf3-4462-b738-de936afcc465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:31 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 1073741824 Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04717ff4-c800-4bdc-babc-7767441c575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:31 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 (7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2): created successfully Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04717ff4-c800-4bdc-babc-7767441c575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (bc7e7f22-4604-46e5-90b1-e33c06686c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-06ef4c8d-3840-44ce-b0a5-1035973be26e tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:31 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb Nov 06 21:29:31 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 1073741824" returned: 0 in 0.471s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 Nov 06 21:29:31 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-quobyte-6617a7e9-d349-443a-8bdc-6ff3b7af64cb" released by "delete_volume" :: held 0.790s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Created reservations ['02ff1152-ab14-46a6-a016-0def3d1ccf7b', '8fe6b871-8b81-4ffc-b297-710bcd0db732', 'eede45f7-64c8-4c41-b7c6-c295e0a93c3d', '816ffa78-76cf-4301-8c0a-754052dcaff7'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:31 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" returned: 0 in 0.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397241536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3704f65-0c17-4152-98f4-2f6283f130b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e47149dcea44e5b76d623471381017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:30Z,use_quota=True,user_id='69eb0c14448e436ea70d991fac0e7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Creating volume f3704f65-0c17-4152-98f4-2f6283f130b6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 1073741824 Nov 06 21:29:31 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa461ccb-e2a5-4cb4-b816-d06ac2dc1d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637bca3c-f39e-4ce7-9ecd-14483c4ee0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 (1512e4c6-3fa1-43c7-812b-96e08b1f9d94): created successfully Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637bca3c-f39e-4ce7-9ecd-14483c4ee0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (a8983269-51e8-46ba-af11-ed75d5cc93ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a6f3a56f-91cb-42f1-9ca3-2f3f663f82f5 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:31 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.301s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Deleted volume successfully. Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0fd86488-e63f-4e12-be51-528727b5f405 tempest-VolumesSnapshotTestJSON-512655639 None] Lock "cinder-6617a7e9-d349-443a-8bdc-6ff3b7af64cb-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:32 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 1073741824" returned: 0 in 0.586s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:32 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 Nov 06 21:29:32 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:32 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7933e269-9e2a-431c-8ac3-d9e5a41ab56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3704f65-0c17-4152-98f4-2f6283f130b6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736e4b13-2144-476f-a557-c97e6e28f4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Volume volume-f3704f65-0c17-4152-98f4-2f6283f130b6 (f3704f65-0c17-4152-98f4-2f6283f130b6): created successfully Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736e4b13-2144-476f-a557-c97e6e28f4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Flow 'volume_create_manager' (0bed7f6e-4587-4d6a-93f3-9a03f16d4279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-31fde9d3-0d6c-4356-8367-36b8c1cde995 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created volume successfully. Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-f3704f65-0c17-4152-98f4-2f6283f130b6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-f3704f65-0c17-4152-98f4-2f6283f130b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-f3704f65-0c17-4152-98f4-2f6283f130b6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-f3704f65-0c17-4152-98f4-2f6283f130b6" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a93ff0-b3fd-4e8b-904b-2e20c0b1f975]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:33 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 Nov 06 21:29:33 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:33 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6" returned: 0 in 0.448s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:33 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6 Nov 06 21:29:33 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:34 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f3704f65-0c17-4152-98f4-2f6283f130b6" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-f3704f65-0c17-4152-98f4-2f6283f130b6" released by "delete_volume" :: held 0.797s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['d5d1d1f9-0242-40ba-8b0e-a0a8f6f6d554', 'fe1f011d-0fac-4d20-a409-63ed118832c9', '94b04161-da07-4e86-9057-afd84782d7d5', '208d2e28-7322-4555-8cf5-ecf889801623'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:34 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:34 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-1512e4c6-3fa1-43c7-812b-96e08b1f9d94-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-1512e4c6-3fa1-43c7-812b-96e08b1f9d94-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a17484-5616-46ad-8beb-b5591d788261]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:34 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.493s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:34 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 Nov 06 21:29:34 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f26fb8ac-d9d8-466c-9cf7-d74365483e9b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-f3704f65-0c17-4152-98f4-2f6283f130b6-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-27f0aaae-04cd-4b31-89f8-b381a86b4215 req-278805dd-f512-44d3-879b-39bee8c45f41 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-27f0aaae-04cd-4b31-89f8-b381a86b4215 req-278805dd-f512-44d3-879b-39bee8c45f41 tempest-TestStampPattern-134097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-27f0aaae-04cd-4b31-89f8-b381a86b4215 req-278805dd-f512-44d3-879b-39bee8c45f41 tempest-TestStampPattern-134097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-27f0aaae-04cd-4b31-89f8-b381a86b4215 req-278805dd-f512-44d3-879b-39bee8c45f41 tempest-TestStampPattern-134097027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-6b556aac-9fa9-4731-a993-03cb8634aaff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15b99b87-f2f4-47a2-a29f-a825f20da1b6', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:29:35 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" returned: 0 in 0.551s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-27f0aaae-04cd-4b31-89f8-b381a86b4215 req-278805dd-f512-44d3-879b-39bee8c45f41 tempest-TestStampPattern-134097027 None] attachment_update completed successfully. Nov 06 21:29:35 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94 Nov 06 21:29:35 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:35 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-1512e4c6-3fa1-43c7-812b-96e08b1f9d94" released by "delete_volume" :: held 0.931s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['bff5f801-644d-4d5c-93d2-c3345f272464', '683726f3-ec8b-42f4-a762-7d1af59aea55', '3d6b6e27-ae33-4421-9117-60696d02ba5b', '4e982f11-cff8-4a20-b1c0-5c96b76a592c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:35 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:35 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:36 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.415s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-574189bc-d17f-4dc8-bb56-21d375544a49 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-1512e4c6-3fa1-43c7-812b-96e08b1f9d94-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[617646a1-b7fa-49ce-88b4-bc1eef22515a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:37 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 Nov 06 21:29:37 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:37 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" returned: 0 in 0.480s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:37 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2 Nov 06 21:29:37 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:37 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2" released by "delete_volume" :: held 0.856s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['7ac9ba4a-9f0b-4247-99c6-a97f111ab5af', 'baaf84c6-35b0-4d92-af60-a00e504bb5e4', 'f6a06951-360a-4a73-9646-68417b3fecef', '8a341603-69fb-4507-86fa-565e2baf9a42'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:38 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:38 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-ef8f86b5-ec08-4993-8061-d1a792f49573-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-ef8f86b5-ec08-4993-8061-d1a792f49573-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-ef8f86b5-ec08-4993-8061-d1a792f49573" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:38 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:38 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-ef8f86b5-ec08-4993-8061-d1a792f49573" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe23e57-f176-4c30-be56-4f745b710325]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:38 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-776d68d5-ba92-4a06-bfbd-1405a3342fc3 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-7fe0bc65-7a9d-4eb4-b8bc-e2fc53f827e2-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:38 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 Nov 06 21:29:38 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:38 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.462s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:29:38 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573" returned: 0 in 0.593s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:38 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573 Nov 06 21:29:38 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-8c61b794-0125-4a6d-a601-72d5b34f0346 req-fff15628-7d98-4c20-be8e-69297fdfa1cc tempest-TestStampPattern-134097027 None] Terminate volume connection completed successfully. Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-8c61b794-0125-4a6d-a601-72d5b34f0346 req-fff15628-7d98-4c20-be8e-69297fdfa1cc tempest-TestStampPattern-134097027 None] Deleting attachment 15b99b87-f2f4-47a2-a29f-a825f20da1b6. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:29:39 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ef8f86b5-ec08-4993-8061-d1a792f49573" returned: 0 in 0.335s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-ef8f86b5-ec08-4993-8061-d1a792f49573" released by "delete_volume" :: held 1.005s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['597fe499-91c3-4473-a30f-c2d19a952679', '6b607175-74e6-4b22-b4bf-f4372864f192', '12ac765f-af2f-4c1c-9074-9690a05fb66b', 'cbd9c4d9-5e2b-40b1-b20f-c4281e18ecdc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:39 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:39 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:39 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-92c271ee-6cc5-4a93-8578-c145fa7e45f0 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-ef8f86b5-ec08-4993-8061-d1a792f49573-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6927af-56cb-42df-ba45-952764474806]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:40 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea Nov 06 21:29:40 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:41 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" returned: 0 in 0.583s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:41 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea Nov 06 21:29:41 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:41 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" returned: 0 in 0.377s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea" released by "delete_volume" :: held 1.066s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['2e355b41-8458-4402-b761-bcb6d7b33a92', 'c539b579-574c-44b9-bd18-15f75e013922', '9068467d-60f6-4514-85b1-e55f54852b87', '0752acaa-1c65-49cc-b3f2-153d765079b3'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:41 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:41 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:42 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.477s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8da4e3d1-f806-4b1a-8be4-f98935a2c15b tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-1cc8a5a4-d5e5-47b3-b0d6-079ffef674ea-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-91365d15-10a7-4340-860a-cf15028742df-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-91365d15-10a7-4340-860a-cf15028742df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "cinder-quobyte-91365d15-10a7-4340-860a-cf15028742df" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-91365d15-10a7-4340-860a-cf15028742df" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa0110-8558-48ae-99dc-7f449bb06769]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df Nov 06 21:29:43 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:43 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df" returned: 0 in 0.551s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df Nov 06 21:29:43 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:43 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-91365d15-10a7-4340-860a-cf15028742df" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-quobyte-91365d15-10a7-4340-860a-cf15028742df" released by "delete_volume" :: held 0.910s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Created reservations ['29c48b7b-e710-4254-adc2-775841e3534a', '94421df3-ae15-411b-b35e-33911c6ece18', 'ec9e06e9-d5dd-411c-b9d4-aa1bad28f769', 'c57ab4c1-925a-4403-9b28-49af694ba6fc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:44 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:44 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:44 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.267s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Deleted volume successfully. Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7aea631e-7909-4213-a85f-6f03a6c9d152 tempest-CreateVolumesFromSourceVolumeTest-1407127962 None] Lock "cinder-91365d15-10a7-4340-860a-cf15028742df-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-6b556aac-9fa9-4731-a993-03cb8634aaff-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "cinder-6b556aac-9fa9-4731-a993-03cb8634aaff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08742d9-e9f7-4b9c-a5fd-8086aa10591c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:44 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff Nov 06 21:29:44 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:45 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff" returned: 0 in 0.481s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:45 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff Nov 06 21:29:45 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:45 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6b556aac-9fa9-4731-a993-03cb8634aaff" returned: 0 in 0.332s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-6b556aac-9fa9-4731-a993-03cb8634aaff" released by "delete_volume" :: held 0.876s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Created reservations ['8d0c6057-eca2-4686-82f1-5f7a2ee87151', '36adcf6d-2a7b-4dad-852c-dceab1185244', 'b882a2fc-d400-4c88-b2e2-46fee605fd77', '7c3e57a7-f9ae-4179-9b0a-b3ee27f99153'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:45 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:45 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:46 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.335s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Deleted volume successfully. Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-6f3e698e-131b-4e40-874d-ac8c3816590c tempest-TestStampPattern-134097027 None] Lock "cinder-6b556aac-9fa9-4731-a993-03cb8634aaff-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Deleting offline snapshot 82a56df9-6376-4bb9-9ae5-80fdd7b513fe of volume 1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] snapshot_file for this snap is: volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad810a-1f53-4b24-9127-0f68a7ed24b4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:46 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:29:46 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:46 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.542s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9f7cb-cdbf-464c-b6fb-8e3d7b848fd3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:47 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:29:47 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:47 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.731s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:47 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:29:47 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Flow 'volume_create_manager' (5bf837b4-f06d-4bb4-8bb1-4841e63d3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471af474-320a-4c50-81ff-21edacd73950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471af474-320a-4c50-81ff-21edacd73950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1854663739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73a6ad3-01e5-4be0-831c-df6965000900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12da94abbcb54d46bed91c0a46a5937f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:48Z,use_quota=True,user_id='861310cc613f44e890cd67f51cd766e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:48 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8d45f-8933-4356-b166-cd1129064242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8d45f-8933-4356-b166-cd1129064242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672abe2a-261e-482c-b7d5-c9d5cb620915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672abe2a-261e-482c-b7d5-c9d5cb620915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73a6ad3-01e5-4be0-831c-df6965000900', 'volume_name': 'volume-b73a6ad3-01e5-4be0-831c-df6965000900', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa2c067-d037-4299-9a3d-f0366a25aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa2c067-d037-4299-9a3d-f0366a25aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f3a3f6-d85e-443f-8c25-81b43c157bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:48 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Volume b73a6ad3-01e5-4be0-831c-df6965000900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73a6ad3-01e5-4be0-831c-df6965000900', 'volume_size': 1} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1854663739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73a6ad3-01e5-4be0-831c-df6965000900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12da94abbcb54d46bed91c0a46a5937f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:48Z,use_quota=True,user_id='861310cc613f44e890cd67f51cd766e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Creating volume b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:48 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:48 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 1073741824 Nov 06 21:29:48 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe Nov 06 21:29:48 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31.82a56df9-6376-4bb9-9ae5-80fdd7b513fe" returned: 0 in 0.381s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-82a56df9-6376-4bb9-9ae5-80fdd7b513fe" released by "_delete_snapshot" :: held 2.440s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" released by "delete_snapshot" :: held 2.475s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Created reservations ['7f395f6c-564e-4576-adb3-487fb619e6ff', '4f8da7cd-93a2-46df-a923-672df9bb0028', '8f61e13e-4932-4a6b-90b2-ed844e8ac4f4', '362cf3ac-e2ed-4f09-af27-9a56639cd1aa'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:48 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 1073741824" returned: 0 in 0.665s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:48 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:29:48 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Delete snapshot completed successfully. Nov 06 21:29:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cde3489d-4387-4e65-80a1-c899695e5c96 tempest-TestStampPattern-134097027 None] Lock "cinder-82a56df9-6376-4bb9-9ae5-80fdd7b513fe-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:49 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.348s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f3a3f6-d85e-443f-8c25-81b43c157bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73a6ad3-01e5-4be0-831c-df6965000900', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e016c2b-f8db-4478-8c2a-faef44c08727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:49 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Volume volume-b73a6ad3-01e5-4be0-831c-df6965000900 (b73a6ad3-01e5-4be0-831c-df6965000900): created successfully Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e016c2b-f8db-4478-8c2a-faef44c08727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:49 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Flow 'volume_create_manager' (5bf837b4-f06d-4bb4-8bb1-4841e63d3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7779ed9e-b451-4b84-ba2c-e773e85c2640 tempest-VolumeDependencyTests-1711967736 None] Created volume successfully. Nov 06 21:29:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:50 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Creating offline snapshot c718af4a-8e7a-44e0-8222-12fe09911807 of volume b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:29:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd2d5d-4ad9-4f4a-a680-a1b6de708c49]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:50 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:29:50 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:51 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.720s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:51 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 1G Nov 06 21:29:51 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:51 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 1G" returned: 0 in 0.610s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73a6ad3-01e5-4be0-831c-df6965000900 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:51 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73a6ad3-01e5-4be0-831c-df6965000900 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:29:51 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:52 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73a6ad3-01e5-4be0-831c-df6965000900 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 is being set with open permissions: ugo+rw Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:52 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:29:52 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:52 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:52 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info Nov 06 21:29:52 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:52 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info" returned: 0 in 0.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:52 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info is being set with open permissions: ugo+rw Nov 06 21:29:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:52 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info Nov 06 21:29:52 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:53 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.info" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4da16adb-45d6-4b2f-a835-2cdfd1c27b9a tempest-VolumeDependencyTests-1711967736 None] Create snapshot completed successfully Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Flow 'volume_create_manager' (45071826-cc05-43e1-89bb-9b663e1b61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8cddc1-1463-4eee-b3a2-5742e3139f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8cddc1-1463-4eee-b3a2-5742e3139f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-764253992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf246ff-938b-4995-85bd-a195978ef4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12da94abbcb54d46bed91c0a46a5937f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c718af4a-8e7a-44e0-8222-12fe09911807,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:54Z,use_quota=True,user_id='861310cc613f44e890cd67f51cd766e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c407e7-fcd4-4681-a687-00727aea0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c407e7-fcd4-4681-a687-00727aea0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f22c9-0385-4b04-b5ee-a4b937813b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f22c9-0385-4b04-b5ee-a4b937813b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bf246ff-938b-4995-85bd-a195978ef4af', 'volume_name': 'volume-2bf246ff-938b-4995-85bd-a195978ef4af', 'volume_size': 1, 'snapshot_id': 'c718af4a-8e7a-44e0-8222-12fe09911807'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93ff240-041f-4262-aadc-72fbba4af949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93ff240-041f-4262-aadc-72fbba4af949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab901b6-f524-49b8-9a45-688ff353674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Volume 2bf246ff-938b-4995-85bd-a195978ef4af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bf246ff-938b-4995-85bd-a195978ef4af', 'volume_size': 1, 'snapshot_id': 'c718af4a-8e7a-44e0-8222-12fe09911807'} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807-2bf246ff-938b-4995-85bd-a195978ef4af" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807-2bf246ff-938b-4995-85bd-a195978ef4af" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Creating volume 2bf246ff-938b-4995-85bd-a195978ef4af from snapshot c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] snapshot: c718af4a-8e7a-44e0-8222-12fe09911807, volume: 2bf246ff-938b-4995-85bd-a195978ef4af, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829ba92-a92e-4fe5-a71b-645e7f17d61f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:54 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:29:54 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-1be1ca03-f1e0-4be5-9c77-a2c304d59d31-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "cinder-1be1ca03-f1e0-4be5-9c77-a2c304d59d31-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Acquiring lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:55 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.503s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73a6ad3-01e5-4be0-831c-df6965000900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96d1be-ce27-4bda-9f4c-ff753c68d030]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[758aa966-b787-403c-9d70-fc03598885a7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:29:55 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:29:55 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.428s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.441s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31 Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:29:55 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af Nov 06 21:29:55 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" returned: 0 in 0.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "cinder-quobyte-1be1ca03-f1e0-4be5-9c77-a2c304d59d31" released by "delete_volume" :: held 0.826s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:55 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Created reservations ['cbb79b1b-f8ec-4b4b-9ab9-155b12bad956', '44f0ab37-9b91-484a-b8c7-b43760839dbb', '9e3221ff-4020-4b7a-bda8-1a307551ba39', '6e00ebec-1d38-4e96-86cf-bc8d6e05e213'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:56 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:29:56 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:56 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.556s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Deleted volume successfully. Nov 06 21:29:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-82429339-4ef1-4958-9c60-3ea425dcfd61 tempest-TestStampPattern-134097027 None] Lock "cinder-1be1ca03-f1e0-4be5-9c77-a2c304d59d31-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:04 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af" returned: 0 in 8.558s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:04 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Converted 1024.00 MB image at 119.62 MB/s Nov 06 21:30:04 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af is being set with open permissions: ugo+rw Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:04 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af Nov 06 21:30:04 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:04 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af" returned: 0 in 0.370s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" released by "_copy_volume_from_snapshot" :: held 10.004s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807-2bf246ff-938b-4995-85bd-a195978ef4af" released by "_create_volume_from_snapshot" :: held 10.089s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.106s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab901b6-f524-49b8-9a45-688ff353674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf246ff-938b-4995-85bd-a195978ef4af', 'volume_size': 1, 'snapshot_id': 'c718af4a-8e7a-44e0-8222-12fe09911807'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd089416-50cb-4839-b9c5-0da402029d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Volume volume-2bf246ff-938b-4995-85bd-a195978ef4af (2bf246ff-938b-4995-85bd-a195978ef4af): created successfully Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd089416-50cb-4839-b9c5-0da402029d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Flow 'volume_create_manager' (45071826-cc05-43e1-89bb-9b663e1b61b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-79d36b37-ac20-4fb4-ac04-159760455ccd tempest-VolumeDependencyTests-1711967736 None] Created volume successfully. Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-c718af4a-8e7a-44e0-8222-12fe09911807-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-c718af4a-8e7a-44e0-8222-12fe09911807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Deleting offline snapshot c718af4a-8e7a-44e0-8222-12fe09911807 of volume b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] snapshot_file for this snap is: volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8cd31-3e15-4ce5-88d0-ab0c704f194e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:05 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:30:05 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:06 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.469s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73a6ad3-01e5-4be0-831c-df6965000900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f343f6-33f5-4924-8c0d-abba58173ce4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:06 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:30:06 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:06 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.629s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:07 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:30:07 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:07 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.474s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:07 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807 Nov 06 21:30:07 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:07 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900.c718af4a-8e7a-44e0-8222-12fe09911807" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-c718af4a-8e7a-44e0-8222-12fe09911807" released by "_delete_snapshot" :: held 2.054s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" released by "delete_snapshot" :: held 2.091s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:07 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Created reservations ['9840a550-b9d2-4b0f-83d5-841d0fc9116d', '33fa5082-bc9c-47c8-8a1b-46a0b1858f8e', '0c7c9388-a192-425b-a6c1-95e193b57370', 'f0b2b6b3-ec5a-44c3-9f7f-d549f03de2eb'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Delete snapshot completed successfully. Nov 06 21:30:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c8d330ea-6bba-48bf-a167-763e29df72a0 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-c718af4a-8e7a-44e0-8222-12fe09911807-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-b73a6ad3-01e5-4be0-831c-df6965000900-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-b73a6ad3-01e5-4be0-831c-df6965000900-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0958a1-2f0f-450b-92c6-ca91abdcaeba]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:09 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:30:09 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:09 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.509s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:09 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900 Nov 06 21:30:09 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:09 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b73a6ad3-01e5-4be0-831c-df6965000900" returned: 0 in 0.290s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-b73a6ad3-01e5-4be0-831c-df6965000900" released by "delete_volume" :: held 0.881s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Created reservations ['5259b59b-a7a2-4fec-a6f7-417757133204', 'd8e03a7a-b312-4578-826d-83001d4e0444', 'ccd9fbf4-f0bc-4cac-a519-058c2d048887', '127d9280-a8ef-42d6-85ce-0d54ef284da8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:10 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:10 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-2bf246ff-938b-4995-85bd-a195978ef4af-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-2bf246ff-938b-4995-85bd-a195978ef4af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc821bba-6816-4600-9e17-d8e3e78f058b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:10 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.393s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Deleted volume successfully. Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91c5ceee-3c4c-453e-9fe8-56260c336e98 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-b73a6ad3-01e5-4be0-831c-df6965000900-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:10 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af Nov 06 21:30:10 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:10 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af" returned: 0 in 0.499s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:10 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af Nov 06 21:30:10 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:11 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2bf246ff-938b-4995-85bd-a195978ef4af" returned: 0 in 0.337s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-quobyte-2bf246ff-938b-4995-85bd-a195978ef4af" released by "delete_volume" :: held 0.919s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Created reservations ['591902c4-5505-41d6-b226-dbc818008762', 'ee72cc4a-2353-4138-be56-cd272f1ad673', '9cdb97ba-742d-48ab-8828-9b832fa2f5c2', '1d9da385-eca2-4f46-9798-c86966faafb8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:11 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:11 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:11 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.397s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Deleted volume successfully. Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=126,cinder:INSERT=43,cinder:UPDATE=182,cinder:DELETE=15 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b6e7f12c-b06d-4e1b-b89d-0fe7e950c392 tempest-VolumeDependencyTests-1711967736 None] Lock "cinder-2bf246ff-938b-4995-85bd-a195978ef4af-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=181,cinder:SELECT=137,cinder:INSERT=47,cinder:DELETE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Flow 'volume_create_manager' (9b3cea17-c554-4b0d-a443-a7330cccabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49af1965-610d-4f81-9042-16b8b48951ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49af1965-610d-4f81-9042-16b8b48951ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141705792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af5c7d1-d888-4d2b-a1e5-fc029694279b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f8e3fa0e964b28bbf2e9163ae5a297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:17Z,use_quota=True,user_id='ce2a8f6c443247a9af7335d5928b9fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1624ccbf-749b-42d0-a484-62d607aeefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1624ccbf-749b-42d0-a484-62d607aeefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab36c9c3-391f-4ccc-9c3e-897df318bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab36c9c3-391f-4ccc-9c3e-897df318bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af5c7d1-d888-4d2b-a1e5-fc029694279b', 'volume_name': 'volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46044ca-a03d-4de0-94d5-fcd7947dca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46044ca-a03d-4de0-94d5-fcd7947dca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb630a57-939b-4567-a760-879ff04f2363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:17 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Volume 6af5c7d1-d888-4d2b-a1e5-fc029694279b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b', 'volume_size': 1} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141705792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af5c7d1-d888-4d2b-a1e5-fc029694279b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f8e3fa0e964b28bbf2e9163ae5a297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:17Z,use_quota=True,user_id='ce2a8f6c443247a9af7335d5928b9fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Creating volume 6af5c7d1-d888-4d2b-a1e5-fc029694279b {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:17 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b 1073741824 Nov 06 21:30:17 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b 1073741824" returned: 0 in 0.698s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b Nov 06 21:30:18 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b" returned: 0 in 0.547s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb630a57-939b-4567-a760-879ff04f2363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b885e85f-87e7-493d-9ecc-725bc521f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Volume volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b (6af5c7d1-d888-4d2b-a1e5-fc029694279b): created successfully Nov 06 21:30:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b885e85f-87e7-493d-9ecc-725bc521f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Flow 'volume_create_manager' (9b3cea17-c554-4b0d-a443-a7330cccabc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-172bcbaf-2ea7-4225-b098-ea4ab5527760 tempest-ProjectReaderTests-1315273186 None] Created volume successfully. Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "cinder-6af5c7d1-d888-4d2b-a1e5-fc029694279b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "cinder-6af5c7d1-d888-4d2b-a1e5-fc029694279b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "cinder-quobyte-6af5c7d1-d888-4d2b-a1e5-fc029694279b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "cinder-quobyte-6af5c7d1-d888-4d2b-a1e5-fc029694279b" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b223ed-e120-4ba6-b9f9-78351d08500a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:20 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b Nov 06 21:30:20 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:20 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:20 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b Nov 06 21:30:20 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:21 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6af5c7d1-d888-4d2b-a1e5-fc029694279b" returned: 0 in 0.275s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "cinder-quobyte-6af5c7d1-d888-4d2b-a1e5-fc029694279b" released by "delete_volume" :: held 0.803s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Created reservations ['55e67a39-27fc-475d-be4c-9c3f35e46c0d', '06873311-a46a-48ad-a03b-14c608035af2', '19bf9977-66a3-4d71-938e-0235909e16ec', '991da795-3c5b-42a0-9d09-bea648025da9'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:21 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:21 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:21 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Deleted volume successfully. Nov 06 21:30:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-34b91a39-90fa-4188-a608-e8192e8eee64 tempest-ProjectReaderTests-1315273186 None] Lock "cinder-6af5c7d1-d888-4d2b-a1e5-fc029694279b-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Flow 'volume_create_manager' (94f1b542-d257-417c-bd36-972c51284292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279b0c1-1b32-4092-8ee1-880792809174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279b0c1-1b32-4092-8ee1-880792809174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095775859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1841f56-8016-4bbd-a2f8-31268a8b5c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f8e3fa0e964b28bbf2e9163ae5a297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:22Z,use_quota=True,user_id='ce2a8f6c443247a9af7335d5928b9fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b44e87-7d15-445c-8edf-9182f5d8bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b44e87-7d15-445c-8edf-9182f5d8bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aebd017-53eb-481e-b8f0-bb6c4236974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aebd017-53eb-481e-b8f0-bb6c4236974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1841f56-8016-4bbd-a2f8-31268a8b5c35', 'volume_name': 'volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75ad3ad-6049-4f42-a4e6-3ba27693a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75ad3ad-6049-4f42-a4e6-3ba27693a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45135001-6c00-4382-806a-2dcff25ac3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Volume a1841f56-8016-4bbd-a2f8-31268a8b5c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35', 'volume_size': 1} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1095775859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1841f56-8016-4bbd-a2f8-31268a8b5c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f8e3fa0e964b28bbf2e9163ae5a297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:22Z,use_quota=True,user_id='ce2a8f6c443247a9af7335d5928b9fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Creating volume a1841f56-8016-4bbd-a2f8-31268a8b5c35 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:22 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:22 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 1073741824 Nov 06 21:30:22 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:23 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 1073741824" returned: 0 in 0.641s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:23 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 Nov 06 21:30:23 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:23 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35" returned: 0 in 0.302s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45135001-6c00-4382-806a-2dcff25ac3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47ac050-ffef-4adb-9538-9cacd1719d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Volume volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 (a1841f56-8016-4bbd-a2f8-31268a8b5c35): created successfully Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47ac050-ffef-4adb-9538-9cacd1719d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Flow 'volume_create_manager' (94f1b542-d257-417c-bd36-972c51284292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f2086bb-5183-46da-8a52-1a9b57be5a47 tempest-ProjectReaderTests-1315273186 None] Created volume successfully. Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Acquiring lock "cinder-a1841f56-8016-4bbd-a2f8-31268a8b5c35-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "cinder-a1841f56-8016-4bbd-a2f8-31268a8b5c35-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Acquiring lock "cinder-quobyte-a1841f56-8016-4bbd-a2f8-31268a8b5c35" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "cinder-quobyte-a1841f56-8016-4bbd-a2f8-31268a8b5c35" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e689efb0-4db7-4cec-afa7-250a24f7d3e2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:24 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 Nov 06 21:30:24 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35 Nov 06 21:30:25 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-a1841f56-8016-4bbd-a2f8-31268a8b5c35" returned: 0 in 0.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "cinder-quobyte-a1841f56-8016-4bbd-a2f8-31268a8b5c35" released by "delete_volume" :: held 0.805s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Created reservations ['1ee7766f-a63a-42b7-a599-10a928eae0eb', 'cf61eef5-1d20-4069-b52a-74e3ba014a96', '95da4066-2002-42da-bf0b-caff4f93c49c', 'd786e32a-3fea-49c2-b397-d222ebdd8af6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:25 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:26 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.365s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Deleted volume successfully. Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9673e4a-30d9-42d5-8f3a-507fbaf2303e tempest-ProjectReaderTests-1315273186 None] Lock "cinder-a1841f56-8016-4bbd-a2f8-31268a8b5c35-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Flow 'volume_create_manager' (a9131060-41fe-4284-b7ca-279e2a21c3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ab13a-23d5-4691-ae5b-b4c90b98d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57ab13a-23d5-4691-ae5b-b4c90b98d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1823031337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85eded2-459f-45d0-93cd-fcf218f5d376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c3d7fb9866473aa3913719b1e0545f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:26Z,use_quota=True,user_id='ccfea4cf4abd42d285f8deecf718de76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28df885e-c00c-40aa-a8b5-5dcfb6487a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28df885e-c00c-40aa-a8b5-5dcfb6487a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f525566-c60f-4be7-abbd-3e1dd153a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f525566-c60f-4be7-abbd-3e1dd153a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85eded2-459f-45d0-93cd-fcf218f5d376', 'volume_name': 'volume-d85eded2-459f-45d0-93cd-fcf218f5d376', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d9d53-b1de-4846-83f1-cde0bf96a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d9d53-b1de-4846-83f1-cde0bf96a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1a11d2-0ee4-4677-a765-ea601c485a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Volume d85eded2-459f-45d0-93cd-fcf218f5d376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85eded2-459f-45d0-93cd-fcf218f5d376', 'volume_size': 1} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1823031337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85eded2-459f-45d0-93cd-fcf218f5d376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c3d7fb9866473aa3913719b1e0545f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:26Z,use_quota=True,user_id='ccfea4cf4abd42d285f8deecf718de76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Creating volume d85eded2-459f-45d0-93cd-fcf218f5d376 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:26 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 1073741824 Nov 06 21:30:26 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:26 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 1073741824" returned: 0 in 0.464s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:26 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 Nov 06 21:30:26 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:27 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376" returned: 0 in 0.346s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1a11d2-0ee4-4677-a765-ea601c485a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85eded2-459f-45d0-93cd-fcf218f5d376', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636436fd-d57f-4f50-aefb-48d33463a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Volume volume-d85eded2-459f-45d0-93cd-fcf218f5d376 (d85eded2-459f-45d0-93cd-fcf218f5d376): created successfully Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636436fd-d57f-4f50-aefb-48d33463a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Flow 'volume_create_manager' (a9131060-41fe-4284-b7ca-279e2a21c3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c3130578-3dfe-4ac1-9058-4c4a417d4557 tempest-TestMinimumBasicScenario-1169088043 None] Created volume successfully. Nov 06 21:30:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4b7b98a9-b4ea-4b31-ab62-d3af8e03d71a req-4428d89e-ca2d-4fd0-b38c-f9fd75dda01f tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4b7b98a9-b4ea-4b31-ab62-d3af8e03d71a req-4428d89e-ca2d-4fd0-b38c-f9fd75dda01f tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-4b7b98a9-b4ea-4b31-ab62-d3af8e03d71a req-4428d89e-ca2d-4fd0-b38c-f9fd75dda01f tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4b7b98a9-b4ea-4b31-ab62-d3af8e03d71a req-4428d89e-ca2d-4fd0-b38c-f9fd75dda01f tempest-TestMinimumBasicScenario-1169088043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-d85eded2-459f-45d0-93cd-fcf218f5d376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24287e60-19d6-4f2f-a552-0bd5913539e5', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:30:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4b7b98a9-b4ea-4b31-ab62-d3af8e03d71a req-4428d89e-ca2d-4fd0-b38c-f9fd75dda01f tempest-TestMinimumBasicScenario-1169088043 None] attachment_update completed successfully. Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (36e706f3-4299-4ac3-aaae-a3ca94913792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46754381-58ee-45fc-bc4d-e16ae303dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46754381-58ee-45fc-bc4d-e16ae303dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833918296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e1972a-c0dc-4299-955f-a82cff4e424a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:36Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02288433-7103-4031-8202-152f0ca0691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02288433-7103-4031-8202-152f0ca0691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b005a5af-1c57-491b-b5ca-238e3ed59c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b005a5af-1c57-491b-b5ca-238e3ed59c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e1972a-c0dc-4299-955f-a82cff4e424a', 'volume_name': 'volume-c7e1972a-c0dc-4299-955f-a82cff4e424a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fb6f20-c67b-48c4-a53e-382c62eda446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fb6f20-c67b-48c4-a53e-382c62eda446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d059fc-4c86-4151-a017-c45ff14a0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:36 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Volume c7e1972a-c0dc-4299-955f-a82cff4e424a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e1972a-c0dc-4299-955f-a82cff4e424a', 'volume_size': 1} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833918296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e1972a-c0dc-4299-955f-a82cff4e424a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:36Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Creating volume c7e1972a-c0dc-4299-955f-a82cff4e424a {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:36 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:36 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a 1073741824 Nov 06 21:30:36 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:37 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a 1073741824" returned: 0 in 0.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:37 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a Nov 06 21:30:37 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:37 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d059fc-4c86-4151-a017-c45ff14a0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e1972a-c0dc-4299-955f-a82cff4e424a', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7511d347-34d5-4ef8-aba6-9c0df4119018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:37 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Volume volume-c7e1972a-c0dc-4299-955f-a82cff4e424a (c7e1972a-c0dc-4299-955f-a82cff4e424a): created successfully Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7511d347-34d5-4ef8-aba6-9c0df4119018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:37 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (36e706f3-4299-4ac3-aaae-a3ca94913792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:37 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-71f55482-7ebe-4fe4-a768-34cf939913a9 tempest-ProjectReaderTests-2089511384 None] Created volume successfully. Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:38 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:38 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:38 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.340s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-c7e1972a-c0dc-4299-955f-a82cff4e424a-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "cinder-c7e1972a-c0dc-4299-955f-a82cff4e424a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-quobyte-c7e1972a-c0dc-4299-955f-a82cff4e424a" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-c7e1972a-c0dc-4299-955f-a82cff4e424a" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a41fe5-db0e-4b2c-b28c-d47b20dcdcf7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:38 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a Nov 06 21:30:38 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:39 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:39 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a Nov 06 21:30:39 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:39 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c7e1972a-c0dc-4299-955f-a82cff4e424a" returned: 0 in 0.256s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-c7e1972a-c0dc-4299-955f-a82cff4e424a" released by "delete_volume" :: held 0.676s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Created reservations ['952a2455-f6b9-40e2-85a0-f29d9837df6f', '1ed456cd-76bc-4e4c-8929-b28aceb423ef', 'af1fa21c-b69d-448f-b593-4387d349f4f6', 'bf9c307c-387b-4add-98b9-6b2ed7b8fa8e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:39 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:39 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:39 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.246s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Deleted volume successfully. Nov 06 21:30:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-56dc32bd-19e4-41bd-acf7-e085990ab4bd tempest-ProjectReaderTests-2089511384 None] Lock "cinder-c7e1972a-c0dc-4299-955f-a82cff4e424a-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (7bd74f30-271f-4615-b93c-940f595ef281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c43785-a883-465b-90ab-e6e7a98646c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c43785-a883-465b-90ab-e6e7a98646c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605259284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcd6714-e460-4872-ba2e-0caf242f94ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:40Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be54f0f4-7962-4810-8406-25a799a53a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be54f0f4-7962-4810-8406-25a799a53a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ba6b9-13c6-4612-add3-c2d7745d9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ba6b9-13c6-4612-add3-c2d7745d9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcd6714-e460-4872-ba2e-0caf242f94ff', 'volume_name': 'volume-3fcd6714-e460-4872-ba2e-0caf242f94ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4595544-49e4-4aff-b437-e0bf0e2ad162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4595544-49e4-4aff-b437-e0bf0e2ad162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe48891b-6429-437b-913b-443a59628e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Volume 3fcd6714-e460-4872-ba2e-0caf242f94ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcd6714-e460-4872-ba2e-0caf242f94ff', 'volume_size': 1} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605259284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcd6714-e460-4872-ba2e-0caf242f94ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:40Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Creating volume 3fcd6714-e460-4872-ba2e-0caf242f94ff {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:40 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:40 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff 1073741824 Nov 06 21:30:40 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:40 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff 1073741824" returned: 0 in 0.471s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:40 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff Nov 06 21:30:40 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:41 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff" returned: 0 in 0.279s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe48891b-6429-437b-913b-443a59628e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcd6714-e460-4872-ba2e-0caf242f94ff', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f915d48d-8001-4d3e-a140-fd8d1cf5a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:41 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Volume volume-3fcd6714-e460-4872-ba2e-0caf242f94ff (3fcd6714-e460-4872-ba2e-0caf242f94ff): created successfully Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f915d48d-8001-4d3e-a140-fd8d1cf5a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (7bd74f30-271f-4615-b93c-940f595ef281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fa6dc5ed-6c8f-4123-a803-3b6a201a9c17 tempest-ProjectReaderTests-2089511384 None] Created volume successfully. Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-3fcd6714-e460-4872-ba2e-0caf242f94ff-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "cinder-3fcd6714-e460-4872-ba2e-0caf242f94ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-quobyte-3fcd6714-e460-4872-ba2e-0caf242f94ff" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-3fcd6714-e460-4872-ba2e-0caf242f94ff" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e852ed6d-d8bf-4f60-8012-b2c1941265e7]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:41 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff Nov 06 21:30:41 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:41 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff" returned: 0 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:41 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff Nov 06 21:30:41 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:42 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3fcd6714-e460-4872-ba2e-0caf242f94ff" returned: 0 in 0.274s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-3fcd6714-e460-4872-ba2e-0caf242f94ff" released by "delete_volume" :: held 0.693s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Created reservations ['287273a0-61ce-44e3-ba0f-36bc6c2be309', 'c9345c2b-acec-4749-ab76-f137afa4a1de', '1c6583ef-182a-47e3-85bd-0befc58ddcff', '7e0fcf0d-b3ff-4915-8534-1ea302116f63'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:42 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:42 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:42 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.292s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Deleted volume successfully. Nov 06 21:30:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-58dfb003-32a2-4d7e-a79c-79d34820e43d tempest-ProjectReaderTests-2089511384 None] Lock "cinder-3fcd6714-e460-4872-ba2e-0caf242f94ff-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (ef0fbc7e-2737-463e-8478-36a882a0d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5f126-f042-4328-8f5c-996dfa713b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5f126-f042-4328-8f5c-996dfa713b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244064090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302e9124-72b5-4f71-bf5b-362bdce63170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:43Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f735ad-3c16-4bd2-9024-396bb1b1b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f735ad-3c16-4bd2-9024-396bb1b1b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a5dc13-808d-471e-ac72-9b2b1a23c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a5dc13-808d-471e-ac72-9b2b1a23c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302e9124-72b5-4f71-bf5b-362bdce63170', 'volume_name': 'volume-302e9124-72b5-4f71-bf5b-362bdce63170', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b19c8c-1e52-4e1a-99f0-682676abecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b19c8c-1e52-4e1a-99f0-682676abecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c582b816-4c63-40fb-b32c-73e89e4c8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Volume 302e9124-72b5-4f71-bf5b-362bdce63170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302e9124-72b5-4f71-bf5b-362bdce63170', 'volume_size': 1} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244064090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302e9124-72b5-4f71-bf5b-362bdce63170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:43Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Creating volume 302e9124-72b5-4f71-bf5b-362bdce63170 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:43 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:43 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 1073741824 Nov 06 21:30:43 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:43 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 1073741824" returned: 0 in 0.430s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:43 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 Nov 06 21:30:43 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:43 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c582b816-4c63-40fb-b32c-73e89e4c8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302e9124-72b5-4f71-bf5b-362bdce63170', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa548b-dae2-4b32-9c31-77c7a327d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:43 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Volume volume-302e9124-72b5-4f71-bf5b-362bdce63170 (302e9124-72b5-4f71-bf5b-362bdce63170): created successfully Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa548b-dae2-4b32-9c31-77c7a327d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:43 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (ef0fbc7e-2737-463e-8478-36a882a0d20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-6d0afc21-0c08-487c-a7ef-dbbee220ea84 tempest-ProjectReaderTests-2089511384 None] Created volume successfully. Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-302e9124-72b5-4f71-bf5b-362bdce63170-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-302e9124-72b5-4f71-bf5b-362bdce63170-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-quobyte-302e9124-72b5-4f71-bf5b-362bdce63170" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-302e9124-72b5-4f71-bf5b-362bdce63170" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb32740-8351-4bce-994e-f5025ddcf701]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:44 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 Nov 06 21:30:44 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:44 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170" returned: 0 in 0.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:44 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170 Nov 06 21:30:44 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:44 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-302e9124-72b5-4f71-bf5b-362bdce63170" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-302e9124-72b5-4f71-bf5b-362bdce63170" released by "delete_volume" :: held 0.718s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Created reservations ['fc3a1846-47f5-4ab2-a9df-e681e87e9024', '0f82b622-f3a1-4a7b-92f0-4d90cad8c27d', '3dd0e4e0-8579-43ea-89ca-b5c21807b42b', '34171d93-5bbc-46e8-ae57-4c9eccba5aa2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:45 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:45 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:45 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Deleted volume successfully. Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-ccae0b60-6eb9-4070-bc3e-70944d48abd8 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-302e9124-72b5-4f71-bf5b-362bdce63170-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (35b044fc-d0d7-4a17-a924-6c178310f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32787492-259b-435e-b5a9-81d62977fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32787492-259b-435e-b5a9-81d62977fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152142100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4544a7e2-cbb3-42a0-8595-cd4a686645ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:46Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527f330c-1c4f-465b-a40a-b47d29b1ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527f330c-1c4f-465b-a40a-b47d29b1ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88357a72-1e26-452e-bb0d-e960a3995397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88357a72-1e26-452e-bb0d-e960a3995397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4544a7e2-cbb3-42a0-8595-cd4a686645ee', 'volume_name': 'volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a804d0cf-e7fa-4d93-9653-96a131d5e765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a804d0cf-e7fa-4d93-9653-96a131d5e765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acbeb6-5169-4cc9-a1ba-a0430727a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Volume 4544a7e2-cbb3-42a0-8595-cd4a686645ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee', 'volume_size': 1} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152142100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4544a7e2-cbb3-42a0-8595-cd4a686645ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531263a25d90410998d15f45d639d400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:46Z,use_quota=True,user_id='0a917736073146b89210f330329c54fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Creating volume 4544a7e2-cbb3-42a0-8595-cd4a686645ee {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:30:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:45 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee 1073741824 Nov 06 21:30:45 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:46 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee 1073741824" returned: 0 in 0.459s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:46 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee Nov 06 21:30:46 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:46 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee" returned: 0 in 0.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acbeb6-5169-4cc9-a1ba-a0430727a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c6c16-9335-482e-a8c3-870581de26df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Volume volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee (4544a7e2-cbb3-42a0-8595-cd4a686645ee): created successfully Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c6c16-9335-482e-a8c3-870581de26df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Flow 'volume_create_manager' (35b044fc-d0d7-4a17-a924-6c178310f711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0a3194aa-7174-4a80-af91-1b5f3ce108fe tempest-ProjectReaderTests-2089511384 None] Created volume successfully. Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-4544a7e2-cbb3-42a0-8595-cd4a686645ee-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-4544a7e2-cbb3-42a0-8595-cd4a686645ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "cinder-quobyte-4544a7e2-cbb3-42a0-8595-cd4a686645ee" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-4544a7e2-cbb3-42a0-8595-cd4a686645ee" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff42792c-de4e-4c46-9067-d7483cfbede3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:48 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee Nov 06 21:30:48 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:48 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee" returned: 0 in 0.379s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:48 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee Nov 06 21:30:48 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:48 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4544a7e2-cbb3-42a0-8595-cd4a686645ee" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-quobyte-4544a7e2-cbb3-42a0-8595-cd4a686645ee" released by "delete_volume" :: held 0.694s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Created reservations ['47d6775b-21b8-4d00-8760-629c94a96aab', '785754bc-1d01-4acf-8b2a-253aa85797c9', 'f7a8d326-17b1-4d6a-a6af-f60e0b6d22fa', 'bbe51da1-e7ea-407a-ac26-75e4504ef2d6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:48 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:30:48 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:49 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.312s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:49 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Deleted volume successfully. Nov 06 21:30:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-cba95f0c-7815-472b-a5fd-fb9881f08757 tempest-ProjectReaderTests-2089511384 None] Lock "cinder-4544a7e2-cbb3-42a0-8595-cd4a686645ee-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:58 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=75,cinder:SELECT=55,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:59 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=45,cinder:INSERT=18,cinder:UPDATE=66,cinder:DELETE=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Flow 'volume_create_manager' (a1ae270e-ab82-4f7c-b54d-06a57b742e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74d223d-6870-400a-a90b-3f893275e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74d223d-6870-400a-a90b-3f893275e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-736702691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9df39f-3fb8-4c7c-9b12-66d664281069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb17a6f9d554f09a6738b3bc797c1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:11Z,use_quota=True,user_id='90ed77de0b9941209db0631b1c305717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b508df7-6fa5-405f-9881-278b7bb7cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b508df7-6fa5-405f-9881-278b7bb7cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67c24ba-7956-48b9-be39-1971b7233d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67c24ba-7956-48b9-be39-1971b7233d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9df39f-3fb8-4c7c-9b12-66d664281069', 'volume_name': 'volume-ec9df39f-3fb8-4c7c-9b12-66d664281069', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fdcb25-48e9-45f1-8ed0-2b80f1e1e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fdcb25-48e9-45f1-8ed0-2b80f1e1e908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acdb256-d5de-423a-a498-c2f27ebefe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Volume ec9df39f-3fb8-4c7c-9b12-66d664281069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9df39f-3fb8-4c7c-9b12-66d664281069', 'volume_size': 1} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-736702691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9df39f-3fb8-4c7c-9b12-66d664281069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb17a6f9d554f09a6738b3bc797c1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:11Z,use_quota=True,user_id='90ed77de0b9941209db0631b1c305717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Creating volume ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:11 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:11 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 1073741824 Nov 06 21:31:11 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:11 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 1073741824" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:11 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:11 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:12 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.264s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acdb256-d5de-423a-a498-c2f27ebefe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9df39f-3fb8-4c7c-9b12-66d664281069', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f010432-b106-4525-b5eb-356b4cdf427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Volume volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 (ec9df39f-3fb8-4c7c-9b12-66d664281069): created successfully Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f010432-b106-4525-b5eb-356b4cdf427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Flow 'volume_create_manager' (a1ae270e-ab82-4f7c-b54d-06a57b742e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b4e2597c-7522-4960-82ba-b85bcfd85068 tempest-SnapshotDependencyTests-33407652 None] Created volume successfully. Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Creating offline snapshot 37d90322-02bc-483f-b1af-04546401117b of volume ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f208b7-b6b5-4171-9cc6-7f70df1a434c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:12 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:12 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:13 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b 1G Nov 06 21:31:13 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b 1G" returned: 0 in 0.531s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:13 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:13 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:13 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:13 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b is being set with open permissions: ugo+rw Nov 06 21:31:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:13 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:13 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:14 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:14 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info Nov 06 21:31:14 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:14 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:14 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info is being set with open permissions: ugo+rw Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:14 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info Nov 06 21:31:14 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-8efb2da5-5b0d-4e6b-a168-c767528eca0d req-78eda498-7bf1-44f6-af14-73affaeafc1c tempest-TestMinimumBasicScenario-1169088043 None] Terminate volume connection completed successfully. Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-8efb2da5-5b0d-4e6b-a168-c767528eca0d req-78eda498-7bf1-44f6-af14-73affaeafc1c tempest-TestMinimumBasicScenario-1169088043 None] Deleting attachment 24287e60-19d6-4f2f-a552-0bd5913539e5. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:31:14 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.info" returned: 0 in 0.291s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5d70b106-8f2f-4bee-9e34-1e63e2a6d2b9 tempest-SnapshotDependencyTests-33407652 None] Create snapshot completed successfully Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "cinder-d85eded2-459f-45d0-93cd-fcf218f5d376-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "cinder-d85eded2-459f-45d0-93cd-fcf218f5d376-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "cinder-quobyte-d85eded2-459f-45d0-93cd-fcf218f5d376" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "cinder-quobyte-d85eded2-459f-45d0-93cd-fcf218f5d376" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[53636543-b020-4f71-b8b7-2cfb70cc37a1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:15 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 Nov 06 21:31:15 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:16 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376" returned: 0 in 0.484s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:16 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376 Nov 06 21:31:16 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Flow 'volume_create_manager' (5ede7081-41a2-496c-b2e1-2c12cc57c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b735e4b-70a2-4bb8-919e-f2f543d9440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:16 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d85eded2-459f-45d0-93cd-fcf218f5d376" returned: 0 in 0.284s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b735e4b-70a2-4bb8-919e-f2f543d9440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4203f192-d581-42eb-be6f-685848d072ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb17a6f9d554f09a6738b3bc797c1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=37d90322-02bc-483f-b1af-04546401117b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:16Z,use_quota=True,user_id='90ed77de0b9941209db0631b1c305717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bd9c6f-71a1-431a-88d5-238d70da066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bd9c6f-71a1-431a-88d5-238d70da066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071d304-2318-463c-ae74-ef5028eb5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071d304-2318-463c-ae74-ef5028eb5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4203f192-d581-42eb-be6f-685848d072ee', 'volume_name': 'volume-4203f192-d581-42eb-be6f-685848d072ee', 'volume_size': 1, 'snapshot_id': '37d90322-02bc-483f-b1af-04546401117b'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce847d2-0864-493d-b812-d422c1b42176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce847d2-0864-493d-b812-d422c1b42176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a71e865-1ad8-40fe-9c6e-b04c4b437cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Volume 4203f192-d581-42eb-be6f-685848d072ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4203f192-d581-42eb-be6f-685848d072ee', 'volume_size': 1, 'snapshot_id': '37d90322-02bc-483f-b1af-04546401117b'} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "cinder-quobyte-d85eded2-459f-45d0-93cd-fcf218f5d376" released by "delete_volume" :: held 0.884s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b-4203f192-d581-42eb-be6f-685848d072ee" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b-4203f192-d581-42eb-be6f-685848d072ee" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Creating volume 4203f192-d581-42eb-be6f-685848d072ee from snapshot 37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] snapshot: 37d90322-02bc-483f-b1af-04546401117b, volume: 4203f192-d581-42eb-be6f-685848d072ee, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Created reservations ['91091947-ce2f-463c-a85c-79cd97a7ff83', '95b9a60c-c068-4a1c-b86d-b0fc2a6396ec', '6521e782-6ac5-47b0-abab-5f8254624359', '6211f4c3-e2d5-46c9-9a3a-1f0fd436fa72'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788920d-62c5-4c60-86e0-6a12a5df1706]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:16 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:16 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:16 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:31:16 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:17 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.406s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9df39f-3fb8-4c7c-9b12-66d664281069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4391601f-a4de-4435-a532-9cd83f36b951]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:17 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.281s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Deleted volume successfully. Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c9e0cb8e-8d33-4227-aa9a-f03c9f9a7803 tempest-TestMinimumBasicScenario-1169088043 None] Lock "cinder-d85eded2-459f-45d0-93cd-fcf218f5d376-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:17 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:17 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:17 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.418s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:31:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:17 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee Nov 06 21:31:17 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee" returned: 0 in 7.476s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:25 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Converted 1024.00 MB image at 136.94 MB/s Nov 06 21:31:25 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee is being set with open permissions: ugo+rw Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee Nov 06 21:31:25 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee" returned: 0 in 0.271s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" released by "_copy_volume_from_snapshot" :: held 8.686s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b-4203f192-d581-42eb-be6f-685848d072ee" released by "_create_volume_from_snapshot" :: held 8.760s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.782s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a71e865-1ad8-40fe-9c6e-b04c4b437cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4203f192-d581-42eb-be6f-685848d072ee', 'volume_size': 1, 'snapshot_id': '37d90322-02bc-483f-b1af-04546401117b'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864c5926-de71-4cc0-a141-8f43ee338f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Volume volume-4203f192-d581-42eb-be6f-685848d072ee (4203f192-d581-42eb-be6f-685848d072ee): created successfully Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864c5926-de71-4cc0-a141-8f43ee338f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Flow 'volume_create_manager' (5ede7081-41a2-496c-b2e1-2c12cc57c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f3eb0c15-d165-4dde-a273-24eaf6ba48b3 tempest-SnapshotDependencyTests-33407652 None] Created volume successfully. Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-37d90322-02bc-483f-b1af-04546401117b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-37d90322-02bc-483f-b1af-04546401117b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Deleting offline snapshot 37d90322-02bc-483f-b1af-04546401117b of volume ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] snapshot_file for this snap is: volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb4deb-55e5-4dd6-953f-f49c5d813a54]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:26 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.363s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec9df39f-3fb8-4c7c-9b12-66d664281069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8de4cde-0495-4cc4-a0f1-b8a84533de60]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:26 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:27 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.578s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:27 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:27 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:27 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.368s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:27 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b Nov 06 21:31:27 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:28 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069.37d90322-02bc-483f-b1af-04546401117b" returned: 0 in 0.289s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-37d90322-02bc-483f-b1af-04546401117b" released by "_delete_snapshot" :: held 1.715s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" released by "delete_snapshot" :: held 1.737s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Created reservations ['7b5f0e21-6978-403c-81e2-b5815470b9d6', 'a68938c2-f1f2-4290-bdf6-81a50d1136fb', '0f8fd1ec-1aac-4582-99f2-d5c08f58bac9', 'de5b2172-6972-474a-a30b-aa948ec847f0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Delete snapshot completed successfully. Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a58bf7a8-2718-4dbd-94b9-b6aac9eca148 tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-37d90322-02bc-483f-b1af-04546401117b-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-ec9df39f-3fb8-4c7c-9b12-66d664281069-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-ec9df39f-3fb8-4c7c-9b12-66d664281069-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a5369-a506-4df1-92a6-231bb3dba27c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:28 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:28 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.398s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069 Nov 06 21:31:29 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ec9df39f-3fb8-4c7c-9b12-66d664281069" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-ec9df39f-3fb8-4c7c-9b12-66d664281069" released by "delete_volume" :: held 0.713s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Created reservations ['5b1819e0-f052-4bb7-b212-a5aa6204d636', '37e45ba1-fb41-40ab-8a2f-430f842a1443', '3e62bcb4-2321-4e35-805c-e3beee153062', '562634e2-622f-4896-9741-05d5b790ae8a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:31:29 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-4203f192-d581-42eb-be6f-685848d072ee-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-4203f192-d581-42eb-be6f-685848d072ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:29 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.289s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Deleted volume successfully. Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-55435978-fd46-4ea4-b0be-041902d832fe tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-ec9df39f-3fb8-4c7c-9b12-66d664281069-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[89465fbf-99ea-4aae-b18c-9a430b0cfe6b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:30 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee Nov 06 21:31:30 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:30 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee" returned: 0 in 0.379s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:30 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee Nov 06 21:31:30 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:30 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4203f192-d581-42eb-be6f-685848d072ee" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-quobyte-4203f192-d581-42eb-be6f-685848d072ee" released by "delete_volume" :: held 0.686s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Created reservations ['4ed6979f-60d6-408f-a003-10beccc2bd57', 'cbc02295-b252-4084-806b-27206ade899d', 'fc5d8887-e4b7-43a9-9f2c-716a3adf5751', 'eb31358d-0911-415e-b920-7f7e60fd2514'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:30 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:31:30 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:30 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Deleted volume successfully. Nov 06 21:31:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9378302a-9f5e-4431-94ad-bf5e6b35626b tempest-SnapshotDependencyTests-33407652 None] Lock "cinder-4203f192-d581-42eb-be6f-685848d072ee-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:38 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:31:38 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:38 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.302s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:31:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:31:40 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:40 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=38,cinder:SELECT=30,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Flow 'volume_create_manager' (52ade6e2-2da7-4d55-8695-0b6c34152021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fbb3e6-6183-4cea-9a70-e8e91e20cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fbb3e6-6183-4cea-9a70-e8e91e20cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1132556396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a5fce-776d-4e7d-bf4f-1b237dd591e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310499cc9362439aa2eca0ea11f511d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:54Z,use_quota=True,user_id='4890e6428d2f4df191021ee50bd06453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36933eca-5aed-4d83-bd7a-abf7f4bb8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36933eca-5aed-4d83-bd7a-abf7f4bb8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee09e0-c12a-40d1-8252-99ea185cea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee09e0-c12a-40d1-8252-99ea185cea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108a5fce-776d-4e7d-bf4f-1b237dd591e3', 'volume_name': 'volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8763b8b-c427-420f-88f0-89cf191ea20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8763b8b-c427-420f-88f0-89cf191ea20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd071a4f-d616-46ae-bdc2-5453edc2549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume 108a5fce-776d-4e7d-bf4f-1b237dd591e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3', 'volume_size': 1} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1132556396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a5fce-776d-4e7d-bf4f-1b237dd591e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310499cc9362439aa2eca0ea11f511d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:54Z,use_quota=True,user_id='4890e6428d2f4df191021ee50bd06453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Creating volume 108a5fce-776d-4e7d-bf4f-1b237dd591e3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:54 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:54 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 1073741824 Nov 06 21:31:54 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Flow 'volume_create_manager' (96b97c31-5fa7-491d-b8de-c65ce2763c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c924016-e37a-462a-a6f5-5766ff483ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c924016-e37a-462a-a6f5-5766ff483ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-945602249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52189e08-c6fb-4570-ad49-2b2e59bc4026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310499cc9362439aa2eca0ea11f511d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:55Z,use_quota=True,user_id='4890e6428d2f4df191021ee50bd06453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbda526-6323-44e6-88c7-3e5c44d5d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbda526-6323-44e6-88c7-3e5c44d5d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df07601-fccf-489c-a89d-568ab9c6a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df07601-fccf-489c-a89d-568ab9c6a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52189e08-c6fb-4570-ad49-2b2e59bc4026', 'volume_name': 'volume-52189e08-c6fb-4570-ad49-2b2e59bc4026', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e9510b-ca1e-4f1f-b245-45c5c84df187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e9510b-ca1e-4f1f-b245-45c5c84df187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cd2a32-a32b-4433-96a9-a7ca13ea9e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:54 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume 52189e08-c6fb-4570-ad49-2b2e59bc4026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52189e08-c6fb-4570-ad49-2b2e59bc4026', 'volume_size': 1} Nov 06 21:31:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:55 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 1073741824" returned: 0 in 0.572s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:55 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 Nov 06 21:31:55 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3" returned: 0 in 0.284s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-945602249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52189e08-c6fb-4570-ad49-2b2e59bc4026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310499cc9362439aa2eca0ea11f511d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:55Z,use_quota=True,user_id='4890e6428d2f4df191021ee50bd06453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Creating volume 52189e08-c6fb-4570-ad49-2b2e59bc4026 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd071a4f-d616-46ae-bdc2-5453edc2549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5046bc1-3dcb-4018-b5f5-939abf1c5db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:55 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 1073741824 Nov 06 21:31:55 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 (108a5fce-776d-4e7d-bf4f-1b237dd591e3): created successfully Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5046bc1-3dcb-4018-b5f5-939abf1c5db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Flow 'volume_create_manager' (52ade6e2-2da7-4d55-8695-0b6c34152021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f4d382af-ece8-41ef-bdf4-77830fd2590b tempest-TestServerVolumeAttachmentScenario-168017771 None] Created volume successfully. Nov 06 21:31:55 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 1073741824" returned: 0 in 0.516s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:56 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 Nov 06 21:31:56 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:56 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026" returned: 0 in 0.271s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cd2a32-a32b-4433-96a9-a7ca13ea9e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52189e08-c6fb-4570-ad49-2b2e59bc4026', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979b5c0-96cd-44c0-b606-1f73702f5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:56 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Volume volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 (52189e08-c6fb-4570-ad49-2b2e59bc4026): created successfully Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979b5c0-96cd-44c0-b606-1f73702f5d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:56 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Flow 'volume_create_manager' (96b97c31-5fa7-491d-b8de-c65ce2763c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-84d30974-62e3-43c5-843b-7c95efafa734 tempest-TestServerVolumeAttachmentScenario-168017771 None] Created volume successfully. Nov 06 21:32:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:06 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a2ef208a-4506-4409-a8a6-ab19071ef74d req-8566af04-cc15-4cf7-b71b-4160ce1030ee tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a2ef208a-4506-4409-a8a6-ab19071ef74d req-8566af04-cc15-4cf7-b71b-4160ce1030ee tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-a2ef208a-4506-4409-a8a6-ab19071ef74d req-8566af04-cc15-4cf7-b71b-4160ce1030ee tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-a2ef208a-4506-4409-a8a6-ab19071ef74d req-8566af04-cc15-4cf7-b71b-4160ce1030ee tempest-TestServerVolumeAttachmentScenario-168017771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9bf5297-f53a-4ddc-917e-06e9ea59dca8', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:32:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-a2ef208a-4506-4409-a8a6-ab19071ef74d req-8566af04-cc15-4cf7-b71b-4160ce1030ee tempest-TestServerVolumeAttachmentScenario-168017771 None] attachment_update completed successfully. Nov 06 21:32:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6edcc72a-3754-4f3c-94a4-659b7977ad39 req-3186556a-c1ca-4988-80b8-4cbe6b724629 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6edcc72a-3754-4f3c-94a4-659b7977ad39 req-3186556a-c1ca-4988-80b8-4cbe6b724629 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-6edcc72a-3754-4f3c-94a4-659b7977ad39 req-3186556a-c1ca-4988-80b8-4cbe6b724629 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:33 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-6edcc72a-3754-4f3c-94a4-659b7977ad39 req-3186556a-c1ca-4988-80b8-4cbe6b724629 tempest-TestServerVolumeAttachmentScenario-168017771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-52189e08-c6fb-4570-ad49-2b2e59bc4026', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03c22240-907a-4c19-86c3-8b3187638c20', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:32:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-6edcc72a-3754-4f3c-94a4-659b7977ad39 req-3186556a-c1ca-4988-80b8-4cbe6b724629 tempest-TestServerVolumeAttachmentScenario-168017771 None] attachment_update completed successfully. Nov 06 21:32:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-1d5457f0-4f02-4d7a-ab61-341d268ebdab req-7feba9b5-5bca-48d4-b1c3-dab3823e1af6 tempest-TestServerVolumeAttachmentScenario-168017771 None] Terminate volume connection completed successfully. Nov 06 21:32:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-1d5457f0-4f02-4d7a-ab61-341d268ebdab req-7feba9b5-5bca-48d4-b1c3-dab3823e1af6 tempest-TestServerVolumeAttachmentScenario-168017771 None] Deleting attachment 03c22240-907a-4c19-86c3-8b3187638c20. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:32:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-d15008be-181a-4a86-8882-02e5b9c1a48e req-5f7f31b8-268d-4571-92ac-e94eb0d806cb tempest-TestServerVolumeAttachmentScenario-168017771 None] Terminate volume connection completed successfully. Nov 06 21:32:36 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-d15008be-181a-4a86-8882-02e5b9c1a48e req-5f7f31b8-268d-4571-92ac-e94eb0d806cb tempest-TestServerVolumeAttachmentScenario-168017771 None] Deleting attachment c9bf5297-f53a-4ddc-917e-06e9ea59dca8. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:38 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:32:38 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:38 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:32:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:32:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "cinder-52189e08-c6fb-4570-ad49-2b2e59bc4026-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-52189e08-c6fb-4570-ad49-2b2e59bc4026-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "cinder-quobyte-52189e08-c6fb-4570-ad49-2b2e59bc4026" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-quobyte-52189e08-c6fb-4570-ad49-2b2e59bc4026" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e1953-6f66-4a45-b75e-ea922f116959]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:41 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 Nov 06 21:32:41 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:41 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026" returned: 0 in 0.365s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:41 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026 Nov 06 21:32:41 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:41 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-52189e08-c6fb-4570-ad49-2b2e59bc4026" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-quobyte-52189e08-c6fb-4570-ad49-2b2e59bc4026" released by "delete_volume" :: held 0.663s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Created reservations ['3b1ddbd2-6ccf-455d-aeb5-8ba780855e9b', '0f700bb0-8135-4329-8a45-b891c32c5a6d', '6e52178d-b0d1-4fde-9853-addbde5938a6', 'cc9e0c20-07b2-446e-96f1-cd919ae71c0d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:41 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:32:41 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.243s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Deleted volume successfully. Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd1ff92a-8d4b-4fec-8bee-a50fcda76635 tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-52189e08-c6fb-4570-ad49-2b2e59bc4026-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "cinder-108a5fce-776d-4e7d-bf4f-1b237dd591e3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-108a5fce-776d-4e7d-bf4f-1b237dd591e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "cinder-quobyte-108a5fce-776d-4e7d-bf4f-1b237dd591e3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-quobyte-108a5fce-776d-4e7d-bf4f-1b237dd591e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cba056-abe2-43f6-a6c8-c9575b3bfe9b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:42 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 Nov 06 21:32:42 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3" returned: 0 in 0.366s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:42 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3 Nov 06 21:32:42 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-108a5fce-776d-4e7d-bf4f-1b237dd591e3" returned: 0 in 0.252s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-quobyte-108a5fce-776d-4e7d-bf4f-1b237dd591e3" released by "delete_volume" :: held 0.678s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:42 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Created reservations ['777574ee-dcf8-4dc4-acb4-e674828e8ed0', '3fb11f03-4751-4f79-8d9a-fade3b6a6a8f', '7d2a3a00-6e0c-45b2-852f-1412f66df894', '6ce270c5-ee31-42fc-9cbc-295f9b2fd122'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:43 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:32:43 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:43 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Deleted volume successfully. Nov 06 21:32:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-67bef12c-6997-4cca-a518-8829471785ad tempest-TestServerVolumeAttachmentScenario-168017771 None] Lock "cinder-108a5fce-776d-4e7d-bf4f-1b237dd591e3-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:52 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:53 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:13 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Flow 'volume_create_manager' (617c9a5b-5580-4221-bdb1-7560dd9b269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e64f93-db3e-4721-bf58-4dfb179252d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e64f93-db3e-4721-bf58-4dfb179252d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-743208878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72b2528-a90a-4586-9729-b61e37209798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf2ddd4f457483786a0f83b1c7a4375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:15Z,use_quota=True,user_id='61ed20ad9ced469690322a080291559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ffe2e0-d5b7-4509-b0d5-0174a34882cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ffe2e0-d5b7-4509-b0d5-0174a34882cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b2d964-8626-44ad-bebe-5c5d0de15f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:14 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b2d964-8626-44ad-bebe-5c5d0de15f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c72b2528-a90a-4586-9729-b61e37209798', 'volume_name': 'volume-c72b2528-a90a-4586-9729-b61e37209798', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea86596-78ae-4af0-9f2e-cd287f3d533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea86596-78ae-4af0-9f2e-cd287f3d533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc470d-71d1-41b1-b568-b506f3a6e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Volume c72b2528-a90a-4586-9729-b61e37209798: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c72b2528-a90a-4586-9729-b61e37209798', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Trying to clone c72b2528-a90a-4586-9729-b61e37209798 from image 007d3188-64b0-400e-a10b-94dd7e89a175 at location (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:33:15 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a947959-4c98-4293-b093-8b9c99706d76]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:15 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD Nov 06 21:33:15 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:15 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:15 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 is fetched for user 61ed20ad9ced469690322a080291559a. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e58c16-9ad4-4726-86a9-b2b9fbc1a16d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:16 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD Nov 06 21:33:16 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:16 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-743208878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72b2528-a90a-4586-9729-b61e37209798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf2ddd4f457483786a0f83b1c7a4375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:15Z,use_quota=True,user_id='61ed20ad9ced469690322a080291559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Creating volume c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:33:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:16 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1073741824 Nov 06 21:33:16 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:16 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1073741824" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:16 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 Nov 06 21:33:16 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:17 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Attempting download of 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume c72b2528-a90a-4586-9729-b61e37209798. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ed6d35-7ba3-467d-9c38-330959bcabf0]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:17 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb Nov 06 21:33:17 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:17 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:17 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb Nov 06 21:33:17 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:17 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb" returned: 1 in 0.364s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_007d3188-64b0-400e-a10b-94dd7e89a175_72jjdoeb' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b4fee-8a5f-47d4-81d6-34191dd492c2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:33:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:18 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD Nov 06 21:33:18 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:18 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:18 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] 007d3188-64b0-400e-a10b-94dd7e89a175 was qcow2, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:33:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:18 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 Nov 06 21:33:18 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:20 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798" returned: 0 in 1.987s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_007d3188-64b0-400e-a10b-94dd7e89a175_av4l0c0jdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:33:20 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Converted 112.00 MB image at 56.32 MB/s Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:20 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1G Nov 06 21:33:20 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:20 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 1G" returned: 0 in 0.316s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Downloaded image 007d3188-64b0-400e-a10b-94dd7e89a175 ((None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}])) to volume c72b2528-a90a-4586-9729-b61e37209798 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Temporary image 007d3188-64b0-400e-a10b-94dd7e89a175 for user 61ed20ad9ced469690322a080291559a is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Marking volume c72b2528-a90a-4586-9729-b61e37209798 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Copying metadata from image 007d3188-64b0-400e-a10b-94dd7e89a175 to c72b2528-a90a-4586-9729-b61e37209798. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Creating volume glance metadata for volume c72b2528-a90a-4586-9729-b61e37209798 backed by image 007d3188-64b0-400e-a10b-94dd7e89a175 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc470d-71d1-41b1-b568-b506f3a6e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72b2528-a90a-4586-9729-b61e37209798', 'volume_size': 1, 'image_id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/007d3188-64b0-400e-a10b-94dd7e89a175', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cac979609f324e248d38d66ca7cc0f57', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '007d3188-64b0-400e-a10b-94dd7e89a175', 'created_at': datetime.datetime(2026, 11, 6, 20, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/007d3188-64b0-400e-a10b-94dd7e89a175/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81216acd-21f5-4925-9394-57d2233849fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Volume volume-c72b2528-a90a-4586-9729-b61e37209798 (c72b2528-a90a-4586-9729-b61e37209798): created successfully Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81216acd-21f5-4925-9394-57d2233849fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Flow 'volume_create_manager' (617c9a5b-5580-4221-bdb1-7560dd9b269e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e23d7238-6e59-463f-8d32-8fff8c4eac0c tempest-TestShelveInstance-136582068 None] Created volume successfully. Nov 06 21:33:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-786ee3e5-288c-440e-a577-6c63e1666a23 req-a06c0b58-fa32-4152-8153-647faffe564c tempest-TestShelveInstance-136582068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-786ee3e5-288c-440e-a577-6c63e1666a23 req-a06c0b58-fa32-4152-8153-647faffe564c tempest-TestShelveInstance-136582068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-786ee3e5-288c-440e-a577-6c63e1666a23 req-a06c0b58-fa32-4152-8153-647faffe564c tempest-TestShelveInstance-136582068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-786ee3e5-288c-440e-a577-6c63e1666a23 req-a06c0b58-fa32-4152-8153-647faffe564c tempest-TestShelveInstance-136582068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-c72b2528-a90a-4586-9729-b61e37209798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c052bef-4b1a-4771-8132-cfa1c1abde9f', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:33:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-786ee3e5-288c-440e-a577-6c63e1666a23 req-a06c0b58-fa32-4152-8153-647faffe564c tempest-TestShelveInstance-136582068 None] attachment_update completed successfully. Nov 06 21:33:33 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:33 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4,cinder:INSERT=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:38 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:33:38 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:38 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:33:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:33:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-4070884c-a1bf-4b43-a87b-c4d4fa53dd66 req-64da8030-842c-4ddc-a067-03f3a81b99ba tempest-TestShelveInstance-136582068 None] Terminate volume connection completed successfully. Nov 06 21:33:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-4070884c-a1bf-4b43-a87b-c4d4fa53dd66 req-64da8030-842c-4ddc-a067-03f3a81b99ba tempest-TestShelveInstance-136582068 None] Deleting attachment 4c052bef-4b1a-4771-8132-cfa1c1abde9f. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9b3e44c4-940b-4bef-a0b9-c5f94ca0ad51 req-758d8160-b0a9-4417-8280-2bf7ad9f6fb9 tempest-TestShelveInstance-136582068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9b3e44c4-940b-4bef-a0b9-c5f94ca0ad51 req-758d8160-b0a9-4417-8280-2bf7ad9f6fb9 tempest-TestShelveInstance-136582068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-9b3e44c4-940b-4bef-a0b9-c5f94ca0ad51 req-758d8160-b0a9-4417-8280-2bf7ad9f6fb9 tempest-TestShelveInstance-136582068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:55 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-9b3e44c4-940b-4bef-a0b9-c5f94ca0ad51 req-758d8160-b0a9-4417-8280-2bf7ad9f6fb9 tempest-TestShelveInstance-136582068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563', 'name': 'volume-c72b2528-a90a-4586-9729-b61e37209798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09682104-e1e1-4f99-adc2-fcf83f315481', 'enforce_multipath': True} {{(pid=87230) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:33:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-9b3e44c4-940b-4bef-a0b9-c5f94ca0ad51 req-758d8160-b0a9-4417-8280-2bf7ad9f6fb9 tempest-TestShelveInstance-136582068 None] attachment_update completed successfully. Nov 06 21:34:05 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:05 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-f8c1b07a-ad30-4de3-af77-bd7a888d3e12 tempest-TestShelveInstance-136582068 None] Terminate volume connection completed successfully. Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-f8c1b07a-ad30-4de3-af77-bd7a888d3e12 tempest-TestShelveInstance-136582068 None] Deleting attachment 09682104-e1e1-4f99-adc2-fcf83f315481. {{(pid=87230) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Acquiring lock "cinder-c72b2528-a90a-4586-9729-b61e37209798-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "cinder-c72b2528-a90a-4586-9729-b61e37209798-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Acquiring lock "cinder-quobyte-c72b2528-a90a-4586-9729-b61e37209798" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "cinder-quobyte-c72b2528-a90a-4586-9729-b61e37209798" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb70e1-1515-4424-9d30-f1480fb2c748]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:23 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 Nov 06 21:34:23 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798" returned: 0 in 0.435s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:24 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798 Nov 06 21:34:24 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c72b2528-a90a-4586-9729-b61e37209798" returned: 0 in 0.271s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "cinder-quobyte-c72b2528-a90a-4586-9729-b61e37209798" released by "delete_volume" :: held 0.770s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.quota [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Created reservations ['b060fd72-9c07-471a-a33c-30d85101af31', '335c421f-e8c2-4f69-bce4-a23a06d948de', 'f73429a4-7789-4862-a1ca-ce84f27997d5', '99fe86e4-ae0e-4b5d-8b7e-6a3ae304a2f6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:24 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:34:24 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.274s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.manager [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Deleted volume successfully. Nov 06 21:34:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [req-c61e122a-8e4c-41a0-9765-c9a2bd3fc4b2 req-cf06db6e-cb86-435b-ac48-8bc8178a07a7 tempest-TestShelveInstance-136582068 None] Lock "cinder-c72b2528-a90a-4586-9729-b61e37209798-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:34 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:34 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:34:38 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:34:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Flow 'volume_create_manager' (6b8cddb4-33b4-492d-b106-05ac135d6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7c43e0-9125-4270-b1ac-ea9c39d4ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7c43e0-9125-4270-b1ac-ea9c39d4ea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c02002-b4b3-4308-a452-ea323504f34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cd144779b4b628c62f20cdae9effa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='ac4735542a8b41f2a018b7b249b3da27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41681370-b055-4ddc-bb7f-9ce4daf93381),volume_type_id=41681370-b055-4ddc-bb7f-9ce4daf93381)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88089354-9661-40f9-b4f9-1ed3327c379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88089354-9661-40f9-b4f9-1ed3327c379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b2a9e3-c6d7-4ea1-86dc-53dd4d27b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b2a9e3-c6d7-4ea1-86dc-53dd4d27b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4c02002-b4b3-4308-a452-ea323504f34e', 'volume_name': 'volume-d4c02002-b4b3-4308-a452-ea323504f34e', 'volume_size': 1, 'image_id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '499b5e5e4baf40d79b86508f6a3d1114', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be9cd144779b4b628c62f20cdae9effa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904a22a27f30eb9f3d4e1cf648d6429c52118abf1c801515f5225f0a0234570a8d2df6893209600989cd9ba89b07dd5f68095dd3b62a25d469bd62cada53884d', 'id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9fa319f2-734f-4308-80af-9c8cefde9250/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765cd9e-5e98-4f7d-8433-52837b79bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765cd9e-5e98-4f7d-8433-52837b79bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e238c0cd-ec8a-4724-9381-6423b0414202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Volume d4c02002-b4b3-4308-a452-ea323504f34e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4c02002-b4b3-4308-a452-ea323504f34e', 'volume_size': 1, 'image_id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '499b5e5e4baf40d79b86508f6a3d1114', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be9cd144779b4b628c62f20cdae9effa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904a22a27f30eb9f3d4e1cf648d6429c52118abf1c801515f5225f0a0234570a8d2df6893209600989cd9ba89b07dd5f68095dd3b62a25d469bd62cada53884d', 'id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9fa319f2-734f-4308-80af-9c8cefde9250/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Trying to clone d4c02002-b4b3-4308-a452-ea323504f34e from image 9fa319f2-734f-4308-80af-9c8cefde9250 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:34:40 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c730c-ac2a-40b1-9dab-2318c68696e4]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:40 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:40 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:40 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:40 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:40 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:41 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Temporary image 9fa319f2-734f-4308-80af-9c8cefde9250 is fetched for user ac4735542a8b41f2a018b7b249b3da27. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce53b195-fd14-428e-ab6c-d1c0d3578421]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:41 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:41 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:41 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:41 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c02002-b4b3-4308-a452-ea323504f34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9cd144779b4b628c62f20cdae9effa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='ac4735542a8b41f2a018b7b249b3da27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41681370-b055-4ddc-bb7f-9ce4daf93381),volume_type_id=41681370-b055-4ddc-bb7f-9ce4daf93381)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Creating volume d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:41 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:34:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1073741824 Nov 06 21:34:41 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1073741824" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:42 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e Nov 06 21:34:42 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Attempting download of 9fa319f2-734f-4308-80af-9c8cefde9250 ((None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}])) to volume d4c02002-b4b3-4308-a452-ea323504f34e. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0714e9d6-d17d-462e-a6bd-7b8c8bc15774]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:42 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks Nov 06 21:34:42 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks Nov 06 21:34:43 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:43 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks" returned: 1 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9fa319f2-734f-4308-80af-9c8cefde9250__5v66jks' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30fa21-6b15-4543-88d9-49be1ed2551f]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:43 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:43 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD Nov 06 21:34:43 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:43 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] 9fa319f2-734f-4308-80af-9c8cefde9250 was raw, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:34:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e Nov 06 21:34:43 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e" returned: 0 in 0.457s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9fa319f2-734f-4308-80af-9c8cefde9250_x0e4bghzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:34:44 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:44 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1G Nov 06 21:34:44 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e 1G" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Downloaded image 9fa319f2-734f-4308-80af-9c8cefde9250 ((None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}])) to volume d4c02002-b4b3-4308-a452-ea323504f34e successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Temporary image 9fa319f2-734f-4308-80af-9c8cefde9250 for user ac4735542a8b41f2a018b7b249b3da27 is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Marking volume d4c02002-b4b3-4308-a452-ea323504f34e as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Copying metadata from image 9fa319f2-734f-4308-80af-9c8cefde9250 to d4c02002-b4b3-4308-a452-ea323504f34e. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Creating volume glance metadata for volume d4c02002-b4b3-4308-a452-ea323504f34e backed by image 9fa319f2-734f-4308-80af-9c8cefde9250 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '499b5e5e4baf40d79b86508f6a3d1114', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e238c0cd-ec8a-4724-9381-6423b0414202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c02002-b4b3-4308-a452-ea323504f34e', 'volume_size': 1, 'image_id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9fa319f2-734f-4308-80af-9c8cefde9250', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '499b5e5e4baf40d79b86508f6a3d1114', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be9cd144779b4b628c62f20cdae9effa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '904a22a27f30eb9f3d4e1cf648d6429c52118abf1c801515f5225f0a0234570a8d2df6893209600989cd9ba89b07dd5f68095dd3b62a25d469bd62cada53884d', 'id': '9fa319f2-734f-4308-80af-9c8cefde9250', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9fa319f2-734f-4308-80af-9c8cefde9250/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48bf10f-7140-4e98-8a2d-e4d035c57dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:44 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Volume volume-d4c02002-b4b3-4308-a452-ea323504f34e (d4c02002-b4b3-4308-a452-ea323504f34e): created successfully Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48bf10f-7140-4e98-8a2d-e4d035c57dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:44 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Flow 'volume_create_manager' (6b8cddb4-33b4-492d-b106-05ac135d6c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-941e5709-02f2-487c-a7d3-9264c8571d35 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Created volume successfully. Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Acquiring lock "cinder-d4c02002-b4b3-4308-a452-ea323504f34e-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "cinder-d4c02002-b4b3-4308-a452-ea323504f34e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Acquiring lock "cinder-quobyte-d4c02002-b4b3-4308-a452-ea323504f34e" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "cinder-quobyte-d4c02002-b4b3-4308-a452-ea323504f34e" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcf3a42-d83e-460e-8939-98c4b7e100ee]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e Nov 06 21:34:45 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e" returned: 0 in 0.370s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e Nov 06 21:34:45 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-d4c02002-b4b3-4308-a452-ea323504f34e" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "cinder-quobyte-d4c02002-b4b3-4308-a452-ea323504f34e" released by "delete_volume" :: held 0.664s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:45 devstack cinder-volume[87230]: WARNING cinder.quota [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:34:45 devstack cinder-volume[87230]: WARNING cinder.quota [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:34:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Created reservations ['4efca4e2-c2fa-4f15-a0af-1a3a61cfd9ef', 'f3705aca-ebd3-4526-a425-e68a93ea1655', '9d58329a-3a2e-4f13-87eb-986b9f36da54', 'c0086fcc-2045-4f84-b283-2a34a95e17a4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:34:46 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:46 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.248s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Deleted volume successfully. Nov 06 21:34:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f8ad3bbf-89ee-4c3d-8619-8e2f5abade61 tempest-VolumeAndVolumeTypeFromImageTest-1596658046 None] Lock "cinder-d4c02002-b4b3-4308-a452-ea323504f34e-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:56 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:56 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Flow 'volume_create_manager' (68af6faf-dc98-4af5-acbd-b3113e38140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecca1cd-5a11-48d3-b426-509f6e806952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecca1cd-5a11-48d3-b426-509f6e806952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd56c246-5a85-4944-a785-a3c1c9746dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fc50ce64014314a6110a6afedb4b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:00Z,use_quota=True,user_id='7c032f4f7f9746139f75921d94df1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6815f11-d1a6-4c50-860e-7ed8dd28c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6815f11-d1a6-4c50-860e-7ed8dd28c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f469ea2e-d20b-47f1-8fee-1dd4034d41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f469ea2e-d20b-47f1-8fee-1dd4034d41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd56c246-5a85-4944-a785-a3c1c9746dd1', 'volume_name': 'volume-bd56c246-5a85-4944-a785-a3c1c9746dd1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0d228-3f8c-43ad-8fc2-1828770247d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0d228-3f8c-43ad-8fc2-1828770247d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc66bdd-9341-410a-ba6d-f58857878c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Volume bd56c246-5a85-4944-a785-a3c1c9746dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd56c246-5a85-4944-a785-a3c1c9746dd1', 'volume_size': 1} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd56c246-5a85-4944-a785-a3c1c9746dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fc50ce64014314a6110a6afedb4b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:00Z,use_quota=True,user_id='7c032f4f7f9746139f75921d94df1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Creating volume bd56c246-5a85-4944-a785-a3c1c9746dd1 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:00 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:00 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 1073741824 Nov 06 21:35:00 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b6d5de50-40a7-44b9-8ffa-04043471fb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3ec3fd-ebfe-438d-a08f-ca4806ad217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3ec3fd-ebfe-438d-a08f-ca4806ad217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506616114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11c0b6b-4e35-40ea-96f3-d65bc9f02a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254c8687-4ff2-4b0b-bbfe-b855877fe3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254c8687-4ff2-4b0b-bbfe-b855877fe3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294ac6bb-4b70-4d97-92e4-04a887389ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294ac6bb-4b70-4d97-92e4-04a887389ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11c0b6b-4e35-40ea-96f3-d65bc9f02a17', 'volume_name': 'volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a535bc02-8b24-4023-8a88-76f80fbac1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a535bc02-8b24-4023-8a88-76f80fbac1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e489b00-8415-4844-97a9-8222da49282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Volume c11c0b6b-4e35-40ea-96f3-d65bc9f02a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17', 'volume_size': 1} Nov 06 21:35:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b4086736-b55e-422e-82eb-3b84f9815123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba99dd-98cf-4bd8-8414-894bfc0e9748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ba99dd-98cf-4bd8-8414-894bfc0e9748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20863344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b48cf2-47ca-4b75-9797-0d5b3ebd6289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b48cf2-47ca-4b75-9797-0d5b3ebd6289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24da756c-ff3e-470e-a54c-1e31c2dd87c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24da756c-ff3e-470e-a54c-1e31c2dd87c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0', 'volume_name': 'volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021e98b-0a90-4029-bf9f-335beb726b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021e98b-0a90-4029-bf9f-335beb726b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063096d0-e112-4b37-a900-a731c65959d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Volume cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0', 'volume_size': 1} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 1073741824" returned: 0 in 0.729s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:01 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 Nov 06 21:35:01 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (cc30cc8f-6781-4e54-a146-a0675881692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe0c79e-251f-47f7-9039-a1a54ac56460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe0c79e-251f-47f7-9039-a1a54ac56460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1677051135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f69e6c-0f65-4cf0-b41b-5da4653485ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7e80d2-640f-473c-9e87-09f3880a1787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7e80d2-640f-473c-9e87-09f3880a1787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db1bf1c-26ff-44a9-a298-8cb3de632cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db1bf1c-26ff-44a9-a298-8cb3de632cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f69e6c-0f65-4cf0-b41b-5da4653485ba', 'volume_name': 'volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3259b2f7-61d9-4a21-a157-458346991b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3259b2f7-61d9-4a21-a157-458346991b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76169f6c-49ab-47ef-a043-e15ce6b095d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume b3f69e6c-0f65-4cf0-b41b-5da4653485ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba', 'volume_size': 1} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:01 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1" returned: 0 in 0.368s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506616114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11c0b6b-4e35-40ea-96f3-d65bc9f02a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Creating volume c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:01 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc66bdd-9341-410a-ba6d-f58857878c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd56c246-5a85-4944-a785-a3c1c9746dd1', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ddfcef-b470-4a3e-aa0d-f0aa23f5711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 1073741824 Nov 06 21:35:01 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:01 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Volume volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 (bd56c246-5a85-4944-a785-a3c1c9746dd1): created successfully Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ddfcef-b470-4a3e-aa0d-f0aa23f5711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Flow 'volume_create_manager' (68af6faf-dc98-4af5-acbd-b3113e38140e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:01 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1d323e07-4584-4214-8c0d-a1e66af4eab3 tempest-CinderUnicodeTest-1591444695 None] Created volume successfully. Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (ca96363e-652d-4f28-a159-7ada8c46cd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac27b5d4-b945-47b6-8d06-87a92dd8eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac27b5d4-b945-47b6-8d06-87a92dd8eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2144526600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3400941-63c4-4c04-92ff-d29de7bf3027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:02Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f62ae-adb1-4bc7-8a5b-e3c7c75e7956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f62ae-adb1-4bc7-8a5b-e3c7c75e7956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a4447c-9574-49c0-9f51-fe2467a71142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:01 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a4447c-9574-49c0-9f51-fe2467a71142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3400941-63c4-4c04-92ff-d29de7bf3027', 'volume_name': 'volume-e3400941-63c4-4c04-92ff-d29de7bf3027', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ecff22-88ab-4621-81a6-d8b51a78db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ecff22-88ab-4621-81a6-d8b51a78db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57818784-74c2-4c00-8972-394d5959afbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Volume e3400941-63c4-4c04-92ff-d29de7bf3027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3400941-63c4-4c04-92ff-d29de7bf3027', 'volume_size': 1} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:02 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 1073741824" returned: 0 in 0.627s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:02 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 Nov 06 21:35:02 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (20583b46-80dd-442a-b9ee-d84b98da7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daae1ec-af25-48f8-97c0-53dace77a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daae1ec-af25-48f8-97c0-53dace77a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889497953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b74baaa-54ee-4322-89f3-cb047c994443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:02Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0048f8-3785-4c6c-a411-73a106f6b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0048f8-3785-4c6c-a411-73a106f6b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3398587b-cd5e-4097-bddc-d85d45f32bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3398587b-cd5e-4097-bddc-d85d45f32bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b74baaa-54ee-4322-89f3-cb047c994443', 'volume_name': 'volume-1b74baaa-54ee-4322-89f3-cb047c994443', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6bc78a-cdbc-4ab6-88d8-c19b0fdbabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6bc78a-cdbc-4ab6-88d8-c19b0fdbabf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81c0ee-bf7b-4dfc-8390-beda13bfc70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Volume 1b74baaa-54ee-4322-89f3-cb047c994443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b74baaa-54ee-4322-89f3-cb047c994443', 'volume_size': 1} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:02 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" returned: 0 in 0.390s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20863344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Creating volume cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:02 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:02 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 1073741824 Nov 06 21:35:02 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e489b00-8415-4844-97a9-8222da49282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c4eee-d2ef-4a93-9acc-c3b0b9a3356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:02 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b28f993f-0cb4-43ed-9456-59ee745c8998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a566663-513c-497b-b4b0-48ab496649b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Volume volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 (c11c0b6b-4e35-40ea-96f3-d65bc9f02a17): created successfully Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c4eee-d2ef-4a93-9acc-c3b0b9a3356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b6d5de50-40a7-44b9-8ffa-04043471fb1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a566663-513c-497b-b4b0-48ab496649b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562682212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c3cd44-d90a-46e5-bd77-d15aa4156752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:03Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3274f75-1c50-4797-bfc9-24512ede48b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3274f75-1c50-4797-bfc9-24512ede48b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d279c5e7-60fb-42da-abfd-85112f0bd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d279c5e7-60fb-42da-abfd-85112f0bd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c3cd44-d90a-46e5-bd77-d15aa4156752', 'volume_name': 'volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e487a1-ac19-4c09-8a70-f7fc8ccae709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e487a1-ac19-4c09-8a70-f7fc8ccae709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aff7fe-a5f9-4722-902b-d3a4355d883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Volume e8c3cd44-d90a-46e5-bd77-d15aa4156752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752', 'volume_size': 1} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7afaa13b-0ad6-44b4-9dac-13436f23d909 tempest-CreateVolumesFromImageTest-6766726 None] Created volume successfully. Nov 06 21:35:03 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 1073741824" returned: 0 in 0.562s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:03 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 Nov 06 21:35:03 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Flow 'volume_create_manager' (231c5910-2611-43cb-8841-5660b95d8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b13e78e-7074-4fb2-a977-35cbf76b7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b13e78e-7074-4fb2-a977-35cbf76b7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1375200196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbe1edc-f346-4377-b489-ac3b6b4a7d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fc50ce64014314a6110a6afedb4b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:04Z,use_quota=True,user_id='7c032f4f7f9746139f75921d94df1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d29712a-12ef-4718-81e2-4201b9d90108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d29712a-12ef-4718-81e2-4201b9d90108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e07d72-184a-4302-be5a-0b2ef798ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e07d72-184a-4302-be5a-0b2ef798ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbe1edc-f346-4377-b489-ac3b6b4a7d59', 'volume_name': 'volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57819b3d-f28d-496d-9bc4-88c3a5082169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57819b3d-f28d-496d-9bc4-88c3a5082169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6d138b-3c05-4556-a405-88fbf0464973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Volume 4bbe1edc-f346-4377-b489-ac3b6b4a7d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59', 'volume_size': 1} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:03 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.101s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1677051135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f69e6c-0f65-4cf0-b41b-5da4653485ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:01Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063096d0-e112-4b37-a900-a731c65959d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba 1073741824 Nov 06 21:35:03 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca496c-2dc4-4925-ae48-41a2971ca0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Volume volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 (cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0): created successfully Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca496c-2dc4-4925-ae48-41a2971ca0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:03 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b4086736-b55e-422e-82eb-3b84f9815123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:03 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e54cf810-3cb2-45a6-aa06-c0201554af6b tempest-CreateVolumesFromImageTest-6766726 None] Created volume successfully. Nov 06 21:35:04 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba 1073741824" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:04 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba Nov 06 21:35:04 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:04 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" returned: 0 in 0.274s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.614s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2144526600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3400941-63c4-4c04-92ff-d29de7bf3027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:02Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Creating volume e3400941-63c4-4c04-92ff-d29de7bf3027 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:04 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 1073741824 Nov 06 21:35:04 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76169f6c-49ab-47ef-a043-e15ce6b095d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6234c-654b-4cef-a3da-04a0cc264b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba (b3f69e6c-0f65-4cf0-b41b-5da4653485ba): created successfully Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6234c-654b-4cef-a3da-04a0cc264b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (cc30cc8f-6781-4e54-a146-a0675881692d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dde67d10-560a-4a08-9b3a-270b8b1daccb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:05 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 1073741824" returned: 0 in 0.514s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:05 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 Nov 06 21:35:05 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Flow 'volume_create_manager' (78e5de94-ccb2-49c3-a49a-df2e17e5d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d03e8b-33ad-4253-888a-2a1fdebb1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d03e8b-33ad-4253-888a-2a1fdebb1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6c0f6e-f088-4983-936b-54595e1fa4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7dcab086245dfbe8ecf50b7213fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:05Z,use_quota=True,user_id='509a45a2a3214f0dabd6707080fa547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a20f8f-fed0-4dd7-8829-5d71205c9de1),volume_type_id=c9a20f8f-fed0-4dd7-8829-5d71205c9de1)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4263c831-a663-41c7-8554-0cfac99d224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4263c831-a663-41c7-8554-0cfac99d224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d66043-a8c1-45c3-b385-5ac274920907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:35:05 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889497953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b74baaa-54ee-4322-89f3-cb047c994443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:02Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Creating volume 1b74baaa-54ee-4322-89f3-cb047c994443 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:05 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:05 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 1073741824 Nov 06 21:35:05 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57818784-74c2-4c00-8972-394d5959afbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3400941-63c4-4c04-92ff-d29de7bf3027', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc69b06c-e3f1-43f5-a84b-15d3d36be380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Volume volume-e3400941-63c4-4c04-92ff-d29de7bf3027 (e3400941-63c4-4c04-92ff-d29de7bf3027): created successfully Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc69b06c-e3f1-43f5-a84b-15d3d36be380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (ca96363e-652d-4f28-a159-7ada8c46cd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5415849b-e254-44c7-a3fb-6aed94aecfa4 tempest-CreateVolumesFromImageTest-6766726 None] Created volume successfully. Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d66043-a8c1-45c3-b385-5ac274920907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe6c0f6e-f088-4983-936b-54595e1fa4be', 'volume_name': 'volume-fe6c0f6e-f088-4983-936b-54595e1fa4be', 'volume_size': 1, 'image_id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c73aa93d08f3f608347888725246571d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0d7dcab086245dfbe8ecf50b7213fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f573b84f0ff4f46a9779a6852e62a4aa210b535e753dbf0a90231fbb09825d2767b56b06574de4e64b20cc2264f9fd74d9eb432f4a764eeda4e3520e8d11b8f', 'id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886a027-f265-471d-bdc8-98167f236ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886a027-f265-471d-bdc8-98167f236ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f20ab32-abbc-46b8-a706-ff173abe6738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Volume fe6c0f6e-f088-4983-936b-54595e1fa4be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe6c0f6e-f088-4983-936b-54595e1fa4be', 'volume_size': 1, 'image_id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c73aa93d08f3f608347888725246571d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0d7dcab086245dfbe8ecf50b7213fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f573b84f0ff4f46a9779a6852e62a4aa210b535e753dbf0a90231fbb09825d2767b56b06574de4e64b20cc2264f9fd74d9eb432f4a764eeda4e3520e8d11b8f', 'id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Trying to clone fe6c0f6e-f088-4983-936b-54595e1fa4be from image db8dfb5d-0744-4992-abb1-9900ebfd13ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:35:05 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa39115-6f45-4a9a-adbc-fde9d31b092f]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:05 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:05 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:06 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 1073741824" returned: 0 in 0.571s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 Nov 06 21:35:06 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:06 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443" returned: 0 in 0.302s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.262s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562682212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c3cd44-d90a-46e5-bd77-d15aa4156752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244e5128259e4c7c802b97d1af715921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:03Z,use_quota=True,user_id='1d60390858c841c48be4b0df9cd981e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Creating volume e8c3cd44-d90a-46e5-bd77-d15aa4156752 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:06 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81c0ee-bf7b-4dfc-8390-beda13bfc70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b74baaa-54ee-4322-89f3-cb047c994443', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:06 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 1073741824 Nov 06 21:35:06 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc40cfe2-dce5-4ce4-8a58-a31152f14a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:06 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Volume volume-1b74baaa-54ee-4322-89f3-cb047c994443 (1b74baaa-54ee-4322-89f3-cb047c994443): created successfully Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc40cfe2-dce5-4ce4-8a58-a31152f14a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (20583b46-80dd-442a-b9ee-d84b98da7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9aee7592-249a-4b39-9f2d-3b90737dc325 tempest-CreateVolumesFromImageTest-6766726 None] Created volume successfully. Nov 06 21:35:06 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Temporary image db8dfb5d-0744-4992-abb1-9900ebfd13ac is fetched for user 509a45a2a3214f0dabd6707080fa547f. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6a1ab-3159-4f0f-a4ac-c2179b10471f]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:06 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 1073741824" returned: 0 in 0.442s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 Nov 06 21:35:06 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:07 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.484s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1375200196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbe1edc-f346-4377-b489-ac3b6b4a7d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fc50ce64014314a6110a6afedb4b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:04Z,use_quota=True,user_id='7c032f4f7f9746139f75921d94df1228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Creating volume 4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:07 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aff7fe-a5f9-4722-902b-d3a4355d883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0850a2a6-b9a3-4157-8ea2-a31ea12c0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:07 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 1073741824 Nov 06 21:35:07 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Volume volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 (e8c3cd44-d90a-46e5-bd77-d15aa4156752): created successfully Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0850a2a6-b9a3-4157-8ea2-a31ea12c0a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Flow 'volume_create_manager' (b28f993f-0cb4-43ed-9456-59ee745c8998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2c065a79-2332-477e-922f-2946fab67240 tempest-CreateVolumesFromImageTest-6766726 None] Created volume successfully. Nov 06 21:35:07 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-e8c3cd44-d90a-46e5-bd77-d15aa4156752-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-e8c3cd44-d90a-46e5-bd77-d15aa4156752-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-quobyte-e8c3cd44-d90a-46e5-bd77-d15aa4156752" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-e8c3cd44-d90a-46e5-bd77-d15aa4156752" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69030dc-2e12-407c-967f-c5ae4644e367]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 Nov 06 21:35:07 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 1073741824" returned: 0 in 0.556s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 Nov 06 21:35:07 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752" returned: 0 in 0.410s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752 Nov 06 21:35:08 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" returned: 0 in 0.270s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.014s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6d138b-3c05-4556-a405-88fbf0464973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415d5614-745f-4ccc-b4a7-019b22cce148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating offline snapshot 3ccf5c13-6507-4313-b639-e0549d2cf55c of volume b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:08 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Volume volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 (4bbe1edc-f346-4377-b489-ac3b6b4a7d59): created successfully Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415d5614-745f-4ccc-b4a7-019b22cce148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Flow 'volume_create_manager' (231c5910-2611-43cb-8841-5660b95d8427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3c9eb-1a43-4886-924d-cae5447c10bb]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f54dc3a9-5e15-4182-aa08-7b54411a81a6 tempest-CinderUnicodeTest-1591444695 None] Created volume successfully. Nov 06 21:35:08 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba Nov 06 21:35:08 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e8c3cd44-d90a-46e5-bd77-d15aa4156752" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-e8c3cd44-d90a-46e5-bd77-d15aa4156752" released by "delete_volume" :: held 0.759s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Created reservations ['3c06347d-0dde-4617-85a9-b9807132325b', '8a6a9706-4fd7-494d-a06b-e92d06174524', '8db92654-9a44-4676-87f0-71e290030e0b', 'cca4f673-d52a-4432-b68c-38038e1b563d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:08 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c 1G Nov 06 21:35:08 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-1b74baaa-54ee-4322-89f3-cb047c994443-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-1b74baaa-54ee-4322-89f3-cb047c994443-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-quobyte-1b74baaa-54ee-4322-89f3-cb047c994443" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:08 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-1b74baaa-54ee-4322-89f3-cb047c994443" acquired by "delete_volume" :: waited 0.038s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:08 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Deleted volume successfully. Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[721694eb-18b3-4777-a226-2c107873cb6e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-adc5e633-5762-4f60-be75-997e7013604f tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-e8c3cd44-d90a-46e5-bd77-d15aa4156752-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:08 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 Nov 06 21:35:08 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c 1G" returned: 0 in 0.582s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:09 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c Nov 06 21:35:09 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:09 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443" returned: 0 in 0.483s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:09 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443 Nov 06 21:35:09 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c is being set with open permissions: ugo+rw Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:09 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c Nov 06 21:35:09 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b74baaa-54ee-4322-89f3-cb047c994443" returned: 0 in 0.273s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-1b74baaa-54ee-4322-89f3-cb047c994443" released by "delete_volume" :: held 0.819s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Created reservations ['42b29b47-226e-431b-9e92-8bf1c4bfecd9', '7944622a-cdff-467a-b78c-068ba8bcad8a', '572400eb-6f7b-41ed-9c5a-95ac13b6382f', 'fa3fc659-e2ca-4225-a1af-587c3c22954c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:09 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:09 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:09 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:09 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info Nov 06 21:35:09 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-e3400941-63c4-4c04-92ff-d29de7bf3027-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-e3400941-63c4-4c04-92ff-d29de7bf3027-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-quobyte-e3400941-63c4-4c04-92ff-d29de7bf3027" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-e3400941-63c4-4c04-92ff-d29de7bf3027" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9cd1b-ba77-46c0-b109-68db6cdc3794]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:10 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Deleted volume successfully. Nov 06 21:35:10 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2fc5742a-243b-41ad-a412-2391dcd3a17b tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-1b74baaa-54ee-4322-89f3-cb047c994443-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info" returned: 0 in 0.332s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:10 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info is being set with open permissions: ugo+rw Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:10 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info Nov 06 21:35:10 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:10 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 Nov 06 21:35:10 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:10 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.info" returned: 0 in 0.300s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.104s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6c0f6e-f088-4983-936b-54595e1fa4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7dcab086245dfbe8ecf50b7213fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:05Z,use_quota=True,user_id='509a45a2a3214f0dabd6707080fa547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9a20f8f-fed0-4dd7-8829-5d71205c9de1),volume_type_id=c9a20f8f-fed0-4dd7-8829-5d71205c9de1)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Creating volume fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:10 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1073741824 Nov 06 21:35:10 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027" returned: 0 in 0.449s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0bc9727b-411c-4895-a064-a5f2607dd703 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Create snapshot completed successfully Nov 06 21:35:10 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027 Nov 06 21:35:10 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:10 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e3400941-63c4-4c04-92ff-d29de7bf3027" returned: 0 in 0.264s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-e3400941-63c4-4c04-92ff-d29de7bf3027" released by "delete_volume" :: held 0.764s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Created reservations ['6da79389-0835-4cb8-b7ac-bdc894dc8415', '4d990259-af08-488c-9027-a4f09a8937e5', '676338f8-8b91-4feb-8b3e-a14bfe03e5e6', '6c76c8f2-6be5-43d0-93bf-bc4a0ffb8292'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:10 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1073741824" returned: 0 in 0.559s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:11 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:11 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be Nov 06 21:35:11 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-quobyte-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23cfa5d-a3e1-4131-9539-25b689de0e17]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.330s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Deleted volume successfully. Nov 06 21:35:11 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f1f1aa8-0f77-4d65-82c6-0c4467820790 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-e3400941-63c4-4c04-92ff-d29de7bf3027-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be" returned: 0 in 0.400s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:11 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 Nov 06 21:35:11 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.278s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Creating offline snapshot f50bd5b9-b536-478f-a300-bb1ece1d8560 of volume 4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Attempting download of db8dfb5d-0744-4992-abb1-9900ebfd13ac ((None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}])) to volume fe6c0f6e-f088-4983-936b-54595e1fa4be. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaec5b5-1822-4b26-9f57-b4bcbb5e08b2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0383d4-3499-4687-8515-953a935bbd43]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 Nov 06 21:35:11 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3 Nov 06 21:35:11 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:11 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" returned: 0 in 0.566s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:11 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0 Nov 06 21:35:11 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" returned: 0 in 0.542s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:12 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3" returned: 0 in 0.498s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:12 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 1G Nov 06 21:35:12 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (c937beb4-78c2-4f2e-9a78-d3c001aa8ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef00fbd-4f0c-41fc-8ba5-09a6fd2f7249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef00fbd-4f0c-41fc-8ba5-09a6fd2f7249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924004074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d93177-e79b-472e-835d-96fc3c85c9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:12Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2507bf-7ce9-47d7-83ef-37e052d23fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2507bf-7ce9-47d7-83ef-37e052d23fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d9d316-3d37-4c91-84fc-e769155157ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d9d316-3d37-4c91-84fc-e769155157ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d93177-e79b-472e-835d-96fc3c85c9b0', 'volume_name': 'volume-94d93177-e79b-472e-835d-96fc3c85c9b0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8120c-a5c5-4026-a139-01d95f545497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f8120c-a5c5-4026-a139-01d95f545497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e9b0a8-b4ce-4e54-8463-f9e17ddeb788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume 94d93177-e79b-472e-835d-96fc3c85c9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d93177-e79b-472e-835d-96fc3c85c9b0', 'volume_size': 1} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0" released by "delete_volume" :: held 1.092s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:12 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3 Nov 06 21:35:12 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Created reservations ['962a941d-4997-4e15-ad02-4b922a5c3a64', '9dfcfb33-a9be-491e-a11e-d2b4500c965b', 'e3ea4bc4-d4c2-41cc-915c-1d472354a937', '2e30746a-eb2d-4c54-a270-04ee283cac40'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:12 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:12 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:12 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (f08afba5-8917-4852-84dd-38f57753b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d9fa1e-1d61-4c73-b712-535748b57d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3" returned: 1 in 0.641s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db8dfb5d-0744-4992-abb1-9900ebfd13ac_8kaj61q3' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd02f69-f3a5-445e-88cd-1a2d2b91cc5c]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d9fa1e-1d61-4c73-b712-535748b57d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373560821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649d99a5-57ee-4b19-97ee-6cb527e112b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:13Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41997703-d93e-4071-bc81-db89025684b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41997703-d93e-4071-bc81-db89025684b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824efa11-e3c6-4272-8bfd-a82b1a171ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824efa11-e3c6-4272-8bfd-a82b1a171ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649d99a5-57ee-4b19-97ee-6cb527e112b3', 'volume_name': 'volume-649d99a5-57ee-4b19-97ee-6cb527e112b3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3949189-48c1-4316-a284-46d441646493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3949189-48c1-4316-a284-46d441646493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc1247f-21a8-44d7-94ce-eaa68b0ec438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume 649d99a5-57ee-4b19-97ee-6cb527e112b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649d99a5-57ee-4b19-97ee-6cb527e112b3', 'volume_size': 1} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 1G" returned: 0 in 0.777s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:12 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 Nov 06 21:35:12 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.396s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:12 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Deleted volume successfully. Nov 06 21:35:12 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:12 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-29c9dd60-5cac-41a6-a83c-247807b786a8 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-cc5e0e2f-0a79-41a9-961c-5e1b75e0d9c0-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:13 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (0acd427e-530e-4a34-9d0d-eaa746fe784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12fcf3-a01c-43bc-9648-005c7647876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:13 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560" returned: 0 in 0.379s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:13 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 is being set with open permissions: ugo+rw Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12fcf3-a01c-43bc-9648-005c7647876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466528076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfb7097-926d-4701-8efc-b4792cf55046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:13Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afc8b9b-bd19-4457-9abc-151f074b487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afc8b9b-bd19-4457-9abc-151f074b487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd750bab-3f4e-4a92-b42f-f7360426695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd750bab-3f4e-4a92-b42f-f7360426695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfb7097-926d-4701-8efc-b4792cf55046', 'volume_name': 'volume-6dfb7097-926d-4701-8efc-b4792cf55046', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb41cb80-a77d-45b0-8815-24b408b3196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb41cb80-a77d-45b0-8815-24b408b3196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef14a6f-6945-446d-ba7c-47eb04c16f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume 6dfb7097-926d-4701-8efc-b4792cf55046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfb7097-926d-4701-8efc-b4792cf55046', 'volume_size': 1} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:13 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD Nov 06 21:35:13 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "cinder-quobyte-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] db8dfb5d-0744-4992-abb1-9900ebfd13ac was raw, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[21acdbca-c0b1-4790-a283-b28ae450182f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:13 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:13 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:13 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be Nov 06 21:35:13 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:13 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info Nov 06 21:35:13 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:13 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 Nov 06 21:35:13 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (1148f2b4-0cea-491c-9b2b-8c616e91e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2a4c1e-0f32-4381-baad-9ffbee720e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2a4c1e-0f32-4381-baad-9ffbee720e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842510060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f26760f-019d-478b-bdd3-cb15f22bb0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:14Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1aafc01-1a64-4b23-bd11-2c81a5a5bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1aafc01-1a64-4b23-bd11-2c81a5a5bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2158d54-d990-4e64-9071-ca24bcd93409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2158d54-d990-4e64-9071-ca24bcd93409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f26760f-019d-478b-bdd3-cb15f22bb0c4', 'volume_name': 'volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e216b032-6631-4603-bfb2-74886149a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e216b032-6631-4603-bfb2-74886149a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834d6617-2a3d-401a-99a2-063744e00568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:13 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume 5f26760f-019d-478b-bdd3-cb15f22bb0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4', 'volume_size': 1} Nov 06 21:35:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:14 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (accdd925-30bf-45d3-9fe4-83d7854c66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d911d-d86b-4e03-b737-4e32d2051cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info" returned: 0 in 0.546s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" returned: 0 in 0.668s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info is being set with open permissions: ugo+rw Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:14 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info Nov 06 21:35:14 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be" returned: 0 in 0.723s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db8dfb5d-0744-4992-abb1-9900ebfd13ac_2l013lfjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:14 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17 Nov 06 21:35:14 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d911d-d86b-4e03-b737-4e32d2051cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031469515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6236713-9b16-4b0c-a1e7-693c3ddb15f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:14Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1G Nov 06 21:35:14 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824e29c-42e4-4c71-a5c0-9e751f339016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824e29c-42e4-4c71-a5c0-9e751f339016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5c80b3-7fb1-4b76-ad19-cedd1b18f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5c80b3-7fb1-4b76-ad19-cedd1b18f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6236713-9b16-4b0c-a1e7-693c3ddb15f8', 'volume_name': 'volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a9bfd-7ca4-419c-8b1b-4700687aa46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a9bfd-7ca4-419c-8b1b-4700687aa46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4199c3b9-7eb5-4aa3-a6ca-7a0aa7178418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume f6236713-9b16-4b0c-a1e7-693c3ddb15f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8', 'volume_size': 1} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:14 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.info" returned: 0 in 0.280s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.389s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924004074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d93177-e79b-472e-835d-96fc3c85c9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:12Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume 94d93177-e79b-472e-835d-96fc3c85c9b0 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:14 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 1073741824 Nov 06 21:35:14 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-quobyte-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17" released by "delete_volume" :: held 1.100s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0039c517-b451-4afc-bddf-2fcd0756605b tempest-CinderUnicodeTest-1591444695 None] Create snapshot completed successfully Nov 06 21:35:14 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be 1G" returned: 0 in 0.384s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Downloaded image db8dfb5d-0744-4992-abb1-9900ebfd13ac ((None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}])) to volume fe6c0f6e-f088-4983-936b-54595e1fa4be successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Temporary image db8dfb5d-0744-4992-abb1-9900ebfd13ac for user 509a45a2a3214f0dabd6707080fa547f is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Marking volume fe6c0f6e-f088-4983-936b-54595e1fa4be as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Created reservations ['2f066156-f0f4-4ab4-b4f6-2dac891d26d9', '8b8f0872-5e9a-4eab-9ae7-c102c7a2f5e1', '8e60f2bc-1d27-4418-9fbe-cca90d910eaf', '6542767e-de9d-47a5-9fe7-6fd957c51daf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Copying metadata from image db8dfb5d-0744-4992-abb1-9900ebfd13ac to fe6c0f6e-f088-4983-936b-54595e1fa4be. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Creating volume glance metadata for volume fe6c0f6e-f088-4983-936b-54595e1fa4be backed by image db8dfb5d-0744-4992-abb1-9900ebfd13ac with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c73aa93d08f3f608347888725246571d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:14 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f20ab32-abbc-46b8-a706-ff173abe6738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6c0f6e-f088-4983-936b-54595e1fa4be', 'volume_size': 1, 'image_id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c73aa93d08f3f608347888725246571d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0d7dcab086245dfbe8ecf50b7213fed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f573b84f0ff4f46a9779a6852e62a4aa210b535e753dbf0a90231fbb09825d2767b56b06574de4e64b20cc2264f9fd74d9eb432f4a764eeda4e3520e8d11b8f', 'id': 'db8dfb5d-0744-4992-abb1-9900ebfd13ac', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db8dfb5d-0744-4992-abb1-9900ebfd13ac/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f03a48-31f7-4169-b21d-3aee9363d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Volume volume-fe6c0f6e-f088-4983-936b-54595e1fa4be (fe6c0f6e-f088-4983-936b-54595e1fa4be): created successfully Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f03a48-31f7-4169-b21d-3aee9363d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Flow 'volume_create_manager' (78e5de94-ccb2-49c3-a49a-df2e17e5d616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:14 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-152d6b30-363b-424d-828f-6ab96ed7a654 tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Created volume successfully. Nov 06 21:35:15 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 1073741824" returned: 0 in 0.481s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:15 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.289s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Deleted volume successfully. Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:15 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 Nov 06 21:35:15 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-44fc3d24-55b3-4b07-a431-e43052adbe66 tempest-CreateVolumesFromImageTest-6766726 None] Lock "cinder-c11c0b6b-4e35-40ea-96f3-d65bc9f02a17-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:15 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0" returned: 0 in 0.293s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373560821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649d99a5-57ee-4b19-97ee-6cb527e112b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:13Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume 649d99a5-57ee-4b19-97ee-6cb527e112b3 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e9b0a8-b4ce-4e54-8463-f9e17ddeb788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d93177-e79b-472e-835d-96fc3c85c9b0', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:15 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 1073741824 Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05678f2-2f1f-4337-b336-12575b436a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:15 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-94d93177-e79b-472e-835d-96fc3c85c9b0 (94d93177-e79b-472e-835d-96fc3c85c9b0): created successfully Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05678f2-2f1f-4337-b336-12575b436a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (c937beb4-78c2-4f2e-9a78-d3c001aa8ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a2c114f6-ece0-4ba0-8dc8-52804131520c tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-f50bd5b9-b536-478f-a300-bb1ece1d8560-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-f50bd5b9-b536-478f-a300-bb1ece1d8560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-quobyte-f50bd5b9-b536-478f-a300-bb1ece1d8560" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-f50bd5b9-b536-478f-a300-bb1ece1d8560" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Deleting offline snapshot f50bd5b9-b536-478f-a300-bb1ece1d8560 of volume 4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] snapshot_file for this snap is: volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b791bf-f680-443d-86a3-223ca7c4d811]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:15 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 Nov 06 21:35:15 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Acquiring lock "cinder-fe6c0f6e-f088-4983-936b-54595e1fa4be-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 1073741824" returned: 0 in 0.662s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "cinder-fe6c0f6e-f088-4983-936b-54595e1fa4be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Acquiring lock "cinder-quobyte-fe6c0f6e-f088-4983-936b-54595e1fa4be" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "cinder-quobyte-fe6c0f6e-f088-4983-936b-54595e1fa4be" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:16 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 Nov 06 21:35:16 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560" returned: 0 in 0.565s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd269ac-3103-4045-b629-ca838dd7bf82]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ad7463-9624-4523-8a76-c04ac132d81f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:16 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be Nov 06 21:35:16 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 Nov 06 21:35:16 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3" returned: 0 in 0.369s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466528076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfb7097-926d-4701-8efc-b4792cf55046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:13Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume 6dfb7097-926d-4701-8efc-b4792cf55046 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:16 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc1247f-21a8-44d7-94ce-eaa68b0ec438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649d99a5-57ee-4b19-97ee-6cb527e112b3', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:16 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 1073741824 Nov 06 21:35:16 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92e2a5d-f56a-444a-9916-7928b688dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 (649d99a5-57ee-4b19-97ee-6cb527e112b3): created successfully Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92e2a5d-f56a-444a-9916-7928b688dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (f08afba5-8917-4852-84dd-38f57753b932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e1e555b8-6b8b-400e-b1f6-791289401b22 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:16 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be" returned: 0 in 0.529s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:16 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be Nov 06 21:35:16 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:16 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" returned: 0 in 0.572s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:17 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 Nov 06 21:35:17 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:17 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-fe6c0f6e-f088-4983-936b-54595e1fa4be" returned: 0 in 0.455s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "cinder-quobyte-fe6c0f6e-f088-4983-936b-54595e1fa4be" released by "delete_volume" :: held 1.086s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:17 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 1073741824" returned: 0 in 0.756s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Created reservations ['4c858519-d291-411f-a5c0-f9d9659ed663', 'ff0fba32-f8d5-431f-ad57-1e7bcff4e7ca', '6aa0f67b-56af-416a-9b4b-01db07a73a5d', '3da6de04-8b1a-4ee1-8120-f2d3dbd415bf'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:17 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 Nov 06 21:35:17 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:17 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560" returned: 0 in 0.582s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:17 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560 Nov 06 21:35:17 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:17 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:17 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:17 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.943s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842510060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f26760f-019d-478b-bdd3-cb15f22bb0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:14Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume 5f26760f-019d-478b-bdd3-cb15f22bb0c4 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:17 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:17 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef14a6f-6945-446d-ba7c-47eb04c16f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfb7097-926d-4701-8efc-b4792cf55046', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 1073741824 Nov 06 21:35:18 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361dcc6b-f0df-463a-93cc-7671891e2119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-6dfb7097-926d-4701-8efc-b4792cf55046 (6dfb7097-926d-4701-8efc-b4792cf55046): created successfully Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361dcc6b-f0df-463a-93cc-7671891e2119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (0acd427e-530e-4a34-9d0d-eaa746fe784d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:18 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d04ea3f7-5264-4af9-9293-3f22aa5cf7a5 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.438s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Deleted volume successfully. Nov 06 21:35:18 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59.f50bd5b9-b536-478f-a300-bb1ece1d8560" returned: 0 in 0.567s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3f077d00-4e29-4be9-9a40-f562c569d77e tempest-VolumeAndVolumeTypeFromImageTest-289060043 None] Lock "cinder-fe6c0f6e-f088-4983-936b-54595e1fa4be-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-f50bd5b9-b536-478f-a300-bb1ece1d8560" released by "_delete_snapshot" :: held 2.463s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" released by "delete_snapshot" :: held 2.499s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Created reservations ['3c93525b-311f-452b-8d4f-75ce8ece40ae', 'a4170c5a-0f95-4c6a-a1ce-2efde27bf0da', '76965345-f193-480c-9928-52ea78d2ac07', '8e2e5501-0f8c-4a98-87bf-bf3dda89bc85'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Delete snapshot completed successfully. Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7bbd37c4-3073-4da0-8844-7f95e2e47b42 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-f50bd5b9-b536-478f-a300-bb1ece1d8560-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:18 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 1073741824" returned: 0 in 0.614s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:18 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 Nov 06 21:35:18 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:18 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4" returned: 0 in 0.298s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.452s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031469515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6236713-9b16-4b0c-a1e7-693c3ddb15f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7b2280f3647f28e7524ef134edeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:14Z,use_quota=True,user_id='9f95cb0f74654345b7594a3f740e8b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Creating volume f6236713-9b16-4b0c-a1e7-693c3ddb15f8 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834d6617-2a3d-401a-99a2-063744e00568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:18 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 1073741824 Nov 06 21:35:18 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed09aa-56e0-44fa-9d21-699aea93bfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 (5f26760f-019d-478b-bdd3-cb15f22bb0c4): created successfully Nov 06 21:35:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eed09aa-56e0-44fa-9d21-699aea93bfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (1148f2b4-0cea-491c-9b2b-8c616e91e17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-4bbe1edc-f346-4377-b489-ac3b6b4a7d59-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5bfbf392-c1ed-4760-8846-1b98481eea08 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-4bbe1edc-f346-4377-b489-ac3b6b4a7d59-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f30f4d1-5b77-4e72-9a84-355ce383f979]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:19 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 Nov 06 21:35:19 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:19 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 1073741824" returned: 0 in 0.675s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:19 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 Nov 06 21:35:19 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:19 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" returned: 0 in 0.633s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:19 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59 Nov 06 21:35:19 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" returned: 0 in 0.346s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4199c3b9-7eb5-4aa3-a6ca-7a0aa7178418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb4fcd6-1fba-4d20-9d1f-abe5504cdf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Volume volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 (f6236713-9b16-4b0c-a1e7-693c3ddb15f8): created successfully Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb4fcd6-1fba-4d20-9d1f-abe5504cdf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Flow 'volume_create_manager' (accdd925-30bf-45d3-9fe4-83d7854c66f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dd48d625-711e-4f31-8c80-3afa7972b2fb tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created volume successfully. Nov 06 21:35:20 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" returned: 0 in 0.316s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-4bbe1edc-f346-4377-b489-ac3b6b4a7d59" released by "delete_volume" :: held 1.051s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Created reservations ['7967dce5-0c84-4241-9b1b-0e06897df629', 'd54f4a07-248d-4091-ab08-39abcce04c4c', '601112de-3bb8-42ad-ae02-94f530251dd8', '788c39c1-3ed8-45c2-b833-c7816b1d6816'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:20 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:20 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-f6236713-9b16-4b0c-a1e7-693c3ddb15f8-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-f6236713-9b16-4b0c-a1e7-693c3ddb15f8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (99e7c1da-7a65-494f-b657-86ecfeae40ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:20 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cb6dad-84e5-467a-8f95-7582881a3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cb6dad-84e5-467a-8f95-7582881a3865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441349437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090e346-ebd5-4bd9-b2b2-36b201da66a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:21Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1530278-5ce6-4648-9c48-8c36a52f64aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1530278-5ce6-4648-9c48-8c36a52f64aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6e7d3b-92f7-46fe-b70b-4eae5f02325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6e7d3b-92f7-46fe-b70b-4eae5f02325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3090e346-ebd5-4bd9-b2b2-36b201da66a2', 'volume_name': 'volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8292612e-e6f3-4f69-bfd7-91bccc7a45eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8292612e-e6f3-4f69-bfd7-91bccc7a45eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd17bdd-4b45-47c1-8fe5-ab0654e68d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume 3090e346-ebd5-4bd9-b2b2-36b201da66a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2', 'volume_size': 1} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441349437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090e346-ebd5-4bd9-b2b2-36b201da66a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:21Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume 3090e346-ebd5-4bd9-b2b2-36b201da66a2 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:20 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Deleted volume successfully. Nov 06 21:35:20 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 1073741824 Nov 06 21:35:20 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5e746ba2-6abe-4f6a-8b4b-6b28991898ca tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-4bbe1edc-f346-4377-b489-ac3b6b4a7d59-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0020425-92eb-4116-a917-8cdd29831680]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:21 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 Nov 06 21:35:21 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-bd56c246-5a85-4944-a785-a3c1c9746dd1-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-bd56c246-5a85-4944-a785-a3c1c9746dd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "cinder-quobyte-bd56c246-5a85-4944-a785-a3c1c9746dd1" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-bd56c246-5a85-4944-a785-a3c1c9746dd1" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:21 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ab449-862f-4911-8575-5d8ae10f58ca]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 1073741824" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" returned: 0 in 0.560s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:21 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8 Nov 06 21:35:21 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 Nov 06 21:35:21 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 Nov 06 21:35:21 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:21 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" returned: 0 in 0.346s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-f6236713-9b16-4b0c-a1e7-693c3ddb15f8" released by "delete_volume" :: held 0.971s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:21 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2" returned: 0 in 0.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['f83ae552-3d24-4c06-ad0b-ced101a3a431', 'd9d2d1f6-b003-4be1-8b31-0f58bf440f0b', '5247365f-e111-412a-919e-8ebe305eac86', '17bbffef-e844-43af-9224-39daa1f9b9f8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:21 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd17bdd-4b45-47c1-8fe5-ab0654e68d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48a1dab-1794-4b4a-b107-dc24eb0ee2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1" returned: 0 in 0.518s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 (3090e346-ebd5-4bd9-b2b2-36b201da66a2): created successfully Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48a1dab-1794-4b4a-b107-dc24eb0ee2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (99e7c1da-7a65-494f-b657-86ecfeae40ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:22 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1 Nov 06 21:35:22 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c9048694-f450-4217-9db3-e8656e311cda tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:22 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:22 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:22 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-bd56c246-5a85-4944-a785-a3c1c9746dd1" returned: 0 in 0.283s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-quobyte-bd56c246-5a85-4944-a785-a3c1c9746dd1" released by "delete_volume" :: held 0.878s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Created reservations ['bbc70f93-6ba6-4cd7-88cf-eeaea29e62ea', 'be4dfab8-d71c-481d-a1fd-ae668bbe6501', '6add32cc-4f1d-43d7-9526-7c151db1f949', 'bc91d83b-e3a1-4373-8447-91a0d7921546'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:22 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c2ef9f4f-14b5-4125-b997-58f6074647c8 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-f6236713-9b16-4b0c-a1e7-693c3ddb15f8-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:22 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:22 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:22 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.298s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Deleted volume successfully. Nov 06 21:35:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-181a8265-603b-46f6-969f-8b816b8e36c8 tempest-CinderUnicodeTest-1591444695 None] Lock "cinder-bd56c246-5a85-4944-a785-a3c1c9746dd1-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-5f26760f-019d-478b-bdd3-cb15f22bb0c4-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-5f26760f-019d-478b-bdd3-cb15f22bb0c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-5f26760f-019d-478b-bdd3-cb15f22bb0c4" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-5f26760f-019d-478b-bdd3-cb15f22bb0c4" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881a961-e8df-4f71-a910-c37eb19d5caf]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:23 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 Nov 06 21:35:23 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (725eab41-2404-4287-9418-9bd4805953f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abc40f5-5ee7-42a6-a5f8-6097237c5c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abc40f5-5ee7-42a6-a5f8-6097237c5c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1242049857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975f5a6-beb0-4ff9-b217-125ce2e8246c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:23Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbefe9e-ff30-415e-a941-211075671189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbefe9e-ff30-415e-a941-211075671189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac780a0-aea7-4715-8edf-53d0a172d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac780a0-aea7-4715-8edf-53d0a172d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4975f5a6-beb0-4ff9-b217-125ce2e8246c', 'volume_name': 'volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a532d96d-aa37-46aa-800e-d192248531ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a532d96d-aa37-46aa-800e-d192248531ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08181ad3-f9a3-4df6-98ab-bfcd5d267a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:23 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume 4975f5a6-beb0-4ff9-b217-125ce2e8246c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c', 'volume_size': 1} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1242049857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975f5a6-beb0-4ff9-b217-125ce2e8246c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:23Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume 4975f5a6-beb0-4ff9-b217-125ce2e8246c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:23 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:23 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c 1073741824 Nov 06 21:35:23 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:23 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4" returned: 0 in 0.679s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:24 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4 Nov 06 21:35:24 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (62976ac8-cb67-4640-9f01-9dbe5ed1c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952ec80-442c-4824-babd-a28577bd670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5f26760f-019d-478b-bdd3-cb15f22bb0c4" returned: 0 in 0.433s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d952ec80-442c-4824-babd-a28577bd670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336655608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7b5b74-bbdc-4315-a2e5-4c5a606946e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:24Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3136e01-83d7-4ada-b2fe-b0f00e25bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3136e01-83d7-4ada-b2fe-b0f00e25bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4e77cf-9fa6-496a-ae8f-40ef0d740931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4e77cf-9fa6-496a-ae8f-40ef0d740931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7b5b74-bbdc-4315-a2e5-4c5a606946e6', 'volume_name': 'volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3db9d5-345b-42f4-ac08-2e9942a44fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3db9d5-345b-42f4-ac08-2e9942a44fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b7417-09e6-4d43-8f04-9c8f7f61a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume ba7b5b74-bbdc-4315-a2e5-4c5a606946e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6', 'volume_size': 1} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:24 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-5f26760f-019d-478b-bdd3-cb15f22bb0c4" released by "delete_volume" :: held 1.279s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c 1073741824" returned: 0 in 0.757s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['9d84e405-cb90-4ec3-b0d7-4368a9833330', 'ae274f1b-6c3b-4af6-b2af-78f44baddecc', '916af0e1-5367-49d7-a20a-4fa5d5b913a4', 'f3e5031c-62c2-40d2-83b7-cc0ce3546148'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:24 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c Nov 06 21:35:24 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:24 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:24 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:25 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (ae07a61b-3ef2-4c68-ae5d-d457e14f92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe87eee-2c39-46d4-8094-f8a6852829c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c" returned: 0 in 0.486s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336655608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7b5b74-bbdc-4315-a2e5-4c5a606946e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:24Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe87eee-2c39-46d4-8094-f8a6852829c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918093528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b75bba-71de-473a-bda0-548a3debbb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:25Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 1073741824 Nov 06 21:35:25 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec417ed-f8b4-485a-bdf5-2dbe9148719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec417ed-f8b4-485a-bdf5-2dbe9148719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c06fe7c-6779-4ed3-b599-5cdc02dd8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c06fe7c-6779-4ed3-b599-5cdc02dd8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b75bba-71de-473a-bda0-548a3debbb45', 'volume_name': 'volume-22b75bba-71de-473a-bda0-548a3debbb45', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504dfd98-4393-4438-ae3d-ae7b7f5bcdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504dfd98-4393-4438-ae3d-ae7b7f5bcdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b68582b-3f90-4561-a429-75e8a3db0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume 22b75bba-71de-473a-bda0-548a3debbb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b75bba-71de-473a-bda0-548a3debbb45', 'volume_size': 1} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08181ad3-f9a3-4df6-98ab-bfcd5d267a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45ec8ef-36aa-4a50-8918-fb95c7bc195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c (4975f5a6-beb0-4ff9-b217-125ce2e8246c): created successfully Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45ec8ef-36aa-4a50-8918-fb95c7bc195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (725eab41-2404-4287-9418-9bd4805953f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8963ac44-9ca3-45c8-a552-894e6746ba24 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e511bc8f-319e-4e68-8710-c6c1e350dc81 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-5f26760f-019d-478b-bdd3-cb15f22bb0c4-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (811e52f7-701c-49a7-8fb7-0560bb813e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d676f651-c15a-4c27-aa37-4f1d3a0209d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d676f651-c15a-4c27-aa37-4f1d3a0209d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752115298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68247548-1ff8-410b-b2a9-bf70dc668cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f3282-2387-4457-9b9d-809eb95b1634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f3282-2387-4457-9b9d-809eb95b1634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a32a171-0d73-466c-84e2-ffb91de7041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a32a171-0d73-466c-84e2-ffb91de7041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68247548-1ff8-410b-b2a9-bf70dc668cdc', 'volume_name': 'volume-68247548-1ff8-410b-b2a9-bf70dc668cdc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0ec21c-4846-4be7-b0c2-5d980854d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0ec21c-4846-4be7-b0c2-5d980854d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f023c138-7815-4b61-bb82-c4df8d6c4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume 68247548-1ff8-410b-b2a9-bf70dc668cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68247548-1ff8-410b-b2a9-bf70dc668cdc', 'volume_size': 1} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:25 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 1073741824" returned: 0 in 0.748s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:25 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 Nov 06 21:35:25 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-6dfb7097-926d-4701-8efc-b4792cf55046-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-6dfb7097-926d-4701-8efc-b4792cf55046-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:26 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" returned: 0 in 0.412s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918093528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b75bba-71de-473a-bda0-548a3debbb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:25Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume 22b75bba-71de-473a-bda0-548a3debbb45 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:26 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-6dfb7097-926d-4701-8efc-b4792cf55046" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b7417-09e6-4d43-8f04-9c8f7f61a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73147f0-15a6-4d30-95ee-07325c0166ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 1073741824 Nov 06 21:35:26 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 (ba7b5b74-bbdc-4315-a2e5-4c5a606946e6): created successfully Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73147f0-15a6-4d30-95ee-07325c0166ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (62976ac8-cb67-4640-9f01-9dbe5ed1c180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-6dfb7097-926d-4701-8efc-b4792cf55046" acquired by "delete_volume" :: waited 0.077s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107636f-6be2-4769-bd10-a5aa33e47e95]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a3ed4299-47ac-488e-8075-f4d36ed960a9 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Flow 'volume_create_manager' (06cd1c8d-6e81-4fe5-b553-4c87078af9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9b98a-ea40-487f-a691-c40bca1aa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9b98a-ea40-487f-a691-c40bca1aa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-486532996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0aa2d3a0404503ba96b2e1ad33d18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='283f480ebd6e41e3b01abe2fe79c7822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230aa052-6f97-4722-992a-7c8755116af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230aa052-6f97-4722-992a-7c8755116af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f0097e-d796-4620-af71-abd3d49e47a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f0097e-d796-4620-af71-abd3d49e47a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6', 'volume_name': 'volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c0b3ae-4669-43cd-a88c-a04dba50cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c0b3ae-4669-43cd-a88c-a04dba50cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df99cc14-2d20-415b-bd85-1a86fe25823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Volume 7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6', 'volume_size': 1} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 Nov 06 21:35:26 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (b9b718a6-1acc-4801-8e43-a1ef62d1bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa7e721-6be8-4dbf-a7dd-7cbdc8926321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa7e721-6be8-4dbf-a7dd-7cbdc8926321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250849700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9e083-cdf2-4311-962c-e90c81debb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518933b2-3736-47f2-9156-b0d48be42d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518933b2-3736-47f2-9156-b0d48be42d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a9c9bc-17b6-4dbf-836f-7a88a28f0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a9c9bc-17b6-4dbf-836f-7a88a28f0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d9e083-cdf2-4311-962c-e90c81debb76', 'volume_name': 'volume-93d9e083-cdf2-4311-962c-e90c81debb76', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c6f70-9341-40b7-bd06-7b024bdf0971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c6f70-9341-40b7-bd06-7b024bdf0971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d270e7dc-2158-4088-8f0c-87d1b64ad106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume 93d9e083-cdf2-4311-962c-e90c81debb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d9e083-cdf2-4311-962c-e90c81debb76', 'volume_size': 1} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 1073741824" returned: 0 in 0.577s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:26 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 Nov 06 21:35:26 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046" returned: 0 in 0.511s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046 Nov 06 21:35:27 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45" returned: 0 in 0.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752115298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68247548-1ff8-410b-b2a9-bf70dc668cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume 68247548-1ff8-410b-b2a9-bf70dc668cdc {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:27 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b68582b-3f90-4561-a429-75e8a3db0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b75bba-71de-473a-bda0-548a3debbb45', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b55e3a-84f5-43d5-8038-4b2d1fe2c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc 1073741824 Nov 06 21:35:27 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6dfb7097-926d-4701-8efc-b4792cf55046" returned: 0 in 0.313s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-6dfb7097-926d-4701-8efc-b4792cf55046" released by "delete_volume" :: held 0.920s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:27 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-22b75bba-71de-473a-bda0-548a3debbb45 (22b75bba-71de-473a-bda0-548a3debbb45): created successfully Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b55e3a-84f5-43d5-8038-4b2d1fe2c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (ae07a61b-3ef2-4c68-ae5d-d457e14f92d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-13d7129b-496c-41ce-a8ba-2babd073e6c6 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['6c9842f7-c057-4229-b609-9f80d4f315c6', '29fe8020-65ba-40e3-97a3-79d6b4f16182', 'cb53e795-f8da-4075-a259-6b6778fde875', '0e54e747-c6da-43bb-bdbe-f601a8abbda0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:27 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc 1073741824" returned: 0 in 0.610s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-741bb2d3-584b-404f-909e-c297c72b0d87 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-6dfb7097-926d-4701-8efc-b4792cf55046-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:27 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc Nov 06 21:35:27 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc" returned: 0 in 0.267s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-486532996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0aa2d3a0404503ba96b2e1ad33d18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='283f480ebd6e41e3b01abe2fe79c7822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Creating volume 7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:28 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f023c138-7815-4b61-bb82-c4df8d6c4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68247548-1ff8-410b-b2a9-bf70dc668cdc', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 1073741824 Nov 06 21:35:28 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7965a7f-db8a-41ed-b4af-fe5b35adda5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:28 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-68247548-1ff8-410b-b2a9-bf70dc668cdc (68247548-1ff8-410b-b2a9-bf70dc668cdc): created successfully Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7965a7f-db8a-41ed-b4af-fe5b35adda5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (811e52f7-701c-49a7-8fb7-0560bb813e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-315fcbfb-3861-47ca-9df6-63e3d0885fe7 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-649d99a5-57ee-4b19-97ee-6cb527e112b3-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-649d99a5-57ee-4b19-97ee-6cb527e112b3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-649d99a5-57ee-4b19-97ee-6cb527e112b3" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-649d99a5-57ee-4b19-97ee-6cb527e112b3" acquired by "delete_volume" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7fa6d7-8670-4183-9301-3a0fe3c64029]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 1073741824" returned: 0 in 0.576s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 Nov 06 21:35:28 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:28 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3" returned: 0 in 0.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250849700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9e083-cdf2-4311-962c-e90c81debb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b0943c800a462aa8d3948d5c763fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='59f30619165b4697a2874328ba71c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Creating volume 93d9e083-cdf2-4311-962c-e90c81debb76 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:29 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3 Nov 06 21:35:29 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df99cc14-2d20-415b-bd85-1a86fe25823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 1073741824 Nov 06 21:35:29 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaf09c7-9f22-4b40-bee7-dae597d29c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Volume volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 (7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6): created successfully Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaf09c7-9f22-4b40-bee7-dae597d29c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Flow 'volume_create_manager' (06cd1c8d-6e81-4fe5-b553-4c87078af9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a9b66ad8-f1a7-40d6-8ed4-7d5ea5e0005d tempest-VolumeDependencyTests-951846362 None] Created volume successfully. Nov 06 21:35:29 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-649d99a5-57ee-4b19-97ee-6cb527e112b3" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-649d99a5-57ee-4b19-97ee-6cb527e112b3" released by "delete_volume" :: held 0.770s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['6b97f94d-82e2-4556-97ec-a7a015dedaec', 'b2cecf18-403b-4b26-b993-03fdbe4e6992', '372f863d-df7c-4053-9b2e-b08c22b447af', 'f2ded590-177c-4936-a86d-b56e296e887b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:29 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 1073741824" returned: 0 in 0.599s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-94d93177-e79b-472e-835d-96fc3c85c9b0-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-94d93177-e79b-472e-835d-96fc3c85c9b0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 Nov 06 21:35:29 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-94d93177-e79b-472e-835d-96fc3c85c9b0" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:29 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-94d93177-e79b-472e-835d-96fc3c85c9b0" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.357s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d5ad7-af15-405e-9fcb-65f41a576d8f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3b4b93ec-b1c2-434c-ae9a-90bfe51c9915 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-649d99a5-57ee-4b19-97ee-6cb527e112b3-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:30 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 Nov 06 21:35:30 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76" returned: 0 in 0.305s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d270e7dc-2158-4088-8f0c-87d1b64ad106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d9e083-cdf2-4311-962c-e90c81debb76', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddbdd31-9f88-45ed-a50f-8dcb05734a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Volume volume-93d9e083-cdf2-4311-962c-e90c81debb76 (93d9e083-cdf2-4311-962c-e90c81debb76): created successfully Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddbdd31-9f88-45ed-a50f-8dcb05734a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Flow 'volume_create_manager' (b9b718a6-1acc-4801-8e43-a1ef62d1bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-44161e17-4144-461e-bb49-ef1f8a8b50d5 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created volume successfully. Nov 06 21:35:30 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0" returned: 0 in 0.482s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0 Nov 06 21:35:30 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Creating offline snapshot 402157df-6ec9-458d-a849-9cd9275cc8e4 of volume 7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a0ad3f-7c41-4a9b-8e65-cde6f867c722]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94d93177-e79b-472e-835d-96fc3c85c9b0" returned: 0 in 0.301s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-94d93177-e79b-472e-835d-96fc3c85c9b0" released by "delete_volume" :: held 0.845s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:30 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:30 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['3753d0a8-6e12-4bb6-91de-3880ac0ec609', '9f59497c-0d5d-4126-bce2-a5d7d77f354f', '9f870a7b-ec1e-4eb7-b96b-685dd9356ede', 'eae3f6c9-3b19-4308-a2f4-189760100d60'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-93d9e083-cdf2-4311-962c-e90c81debb76-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-3ccf5c13-6507-4313-b639-e0549d2cf55c-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:31 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-93d9e083-cdf2-4311-962c-e90c81debb76-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-3ccf5c13-6507-4313-b639-e0549d2cf55c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-3ccf5c13-6507-4313-b639-e0549d2cf55c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-93d9e083-cdf2-4311-962c-e90c81debb76" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-3ccf5c13-6507-4313-b639-e0549d2cf55c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleting offline snapshot 3ccf5c13-6507-4313-b639-e0549d2cf55c of volume b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:31 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] snapshot_file for this snap is: volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-93d9e083-cdf2-4311-962c-e90c81debb76" acquired by "delete_volume" :: waited 0.045s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c2fbf-ec65-476c-b572-399e6644d488]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.612s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ddb00d-f547-45f1-be37-75894580236f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 1G Nov 06 21:35:31 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c Nov 06 21:35:31 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 Nov 06 21:35:31 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.403s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8f71df02-c133-4847-b7b2-d69046d1f9e2 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-94d93177-e79b-472e-835d-96fc3c85c9b0-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:31 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c" returned: 0 in 0.437s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfb7284-5ccf-4bf2-92d6-ccda7115da4e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76" returned: 0 in 0.528s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76 Nov 06 21:35:31 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 1G" returned: 0 in 0.598s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba Nov 06 21:35:31 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:31 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-93d9e083-cdf2-4311-962c-e90c81debb76" returned: 0 in 0.269s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-93d9e083-cdf2-4311-962c-e90c81debb76" released by "delete_volume" :: held 0.860s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['2f75c20b-698c-449a-a880-0abab16adf17', '160dbd69-963a-4460-a8ce-c6db86005ad4', '846efc6c-8fff-4854-8f4f-7e23d02d0f69', 'b30e40ec-37bf-4082-885a-ef626a5311ed'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:32 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" returned: 0 in 0.509s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 is being set with open permissions: ugo+rw Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c Nov 06 21:35:32 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:32 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:32 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-68247548-1ff8-410b-b2a9-bf70dc668cdc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:32 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:32 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-68247548-1ff8-410b-b2a9-bf70dc668cdc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-68247548-1ff8-410b-b2a9-bf70dc668cdc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-68247548-1ff8-410b-b2a9-bf70dc668cdc" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb17f5ab-f41c-4d5b-9fa5-a45bd7ef1662]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.426s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc Nov 06 21:35:32 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.459s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c" returned: 0 in 0.557s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:32 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info Nov 06 21:35:32 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c Nov 06 21:35:32 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d7b493ed-36fd-4aea-a02e-3a52f0981b3f tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-93d9e083-cdf2-4311-962c-e90c81debb76-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc" returned: 0 in 0.531s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc Nov 06 21:35:33 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba.3ccf5c13-6507-4313-b639-e0549d2cf55c" returned: 0 in 0.331s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info" returned: 0 in 0.377s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info is being set with open permissions: ugo+rw Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info Nov 06 21:35:33 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-3ccf5c13-6507-4313-b639-e0549d2cf55c" released by "_delete_snapshot" :: held 2.014s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" released by "delete_snapshot" :: held 2.065s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['62406a69-9257-4bfa-a439-2e74758ef2af', '922c5617-cb3e-482a-ac00-46318e7b3d40', '26508318-7d47-4176-88dd-86bd484f3e32', 'd758e057-d777-4080-afb0-3d12f218e437'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Delete snapshot completed successfully. Nov 06 21:35:33 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-871c2e92-beb3-426c-b438-41e892a997a6 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-3ccf5c13-6507-4313-b639-e0549d2cf55c-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-68247548-1ff8-410b-b2a9-bf70dc668cdc" returned: 0 in 0.379s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-68247548-1ff8-410b-b2a9-bf70dc668cdc" released by "delete_volume" :: held 0.980s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.info" returned: 0 in 0.334s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-835212b7-f57e-496c-baea-7c853edacb43 tempest-VolumeDependencyTests-951846362 None] Create snapshot completed successfully Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['dafb1560-81b2-481a-b2f9-55a656240561', '5a5a3453-6691-4734-b06e-80c59750bd8c', '8e851ce8-fc72-4b3a-b5bb-892f5db2049b', '9d528698-030d-4840-94bd-76691fd04999'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:33 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-224b370a-dd55-4801-b3bc-80a435225cdb tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-68247548-1ff8-410b-b2a9-bf70dc668cdc-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-b3f69e6c-0f65-4cf0-b41b-5da4653485ba-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-b3f69e6c-0f65-4cf0-b41b-5da4653485ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8a09e-7e7e-43f8-b22e-7189b9eaa2f2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Flow 'volume_create_manager' (e02c11e2-6a17-4cf5-a823-81cd213b4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb7d80f-7559-4836-b983-6cb619edabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb7d80f-7559-4836-b983-6cb619edabd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-674412750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961ff0f9-29a9-4868-83d2-a0476bd159dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0aa2d3a0404503ba96b2e1ad33d18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=402157df-6ec9-458d-a849-9cd9275cc8e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:35Z,use_quota=True,user_id='283f480ebd6e41e3b01abe2fe79c7822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525006c3-be7f-484c-9512-27fb14972bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525006c3-be7f-484c-9512-27fb14972bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:34 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba Nov 06 21:35:34 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dbb703-a0bf-4533-ab84-eb208cd95c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dbb703-a0bf-4533-ab84-eb208cd95c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '961ff0f9-29a9-4868-83d2-a0476bd159dc', 'volume_name': 'volume-961ff0f9-29a9-4868-83d2-a0476bd159dc', 'volume_size': 1, 'snapshot_id': '402157df-6ec9-458d-a849-9cd9275cc8e4'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5262afd3-c5e9-480f-b330-1d2bc780ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5262afd3-c5e9-480f-b330-1d2bc780ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c99c1fb-01c5-4ca3-984b-d00ab245013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:34 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Volume 961ff0f9-29a9-4868-83d2-a0476bd159dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-961ff0f9-29a9-4868-83d2-a0476bd159dc', 'volume_size': 1, 'snapshot_id': '402157df-6ec9-458d-a849-9cd9275cc8e4'} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-22b75bba-71de-473a-bda0-548a3debbb45-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4-961ff0f9-29a9-4868-83d2-a0476bd159dc" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-22b75bba-71de-473a-bda0-548a3debbb45-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4-961ff0f9-29a9-4868-83d2-a0476bd159dc" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Creating volume 961ff0f9-29a9-4868-83d2-a0476bd159dc from snapshot 402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] snapshot: 402157df-6ec9-458d-a849-9cd9275cc8e4, volume: 961ff0f9-29a9-4868-83d2-a0476bd159dc, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-22b75bba-71de-473a-bda0-548a3debbb45" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a72e027-751b-490f-a7df-1b5136a754f0]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-22b75bba-71de-473a-bda0-548a3debbb45" acquired by "delete_volume" :: waited 0.034s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc1874-dbc2-4a65-a624-d615a15e2ecd]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" returned: 0 in 0.462s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:35 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba Nov 06 21:35:35 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 Nov 06 21:35:35 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.455s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:35 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" returned: 0 in 0.348s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe9d52-6aa0-4bfb-ac81-903851d3a7c3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-quobyte-b3f69e6c-0f65-4cf0-b41b-5da4653485ba" released by "delete_volume" :: held 0.915s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:35 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Created reservations ['37d60008-fe71-4a85-a3b5-aa450abac817', 'fdcd4c39-dbd6-42f6-8adf-fe33f9981783', 'c364a1e8-0999-4350-954b-45ff185b03c8', 'c0e595b0-8d1a-4e65-8fa9-6fef8df10125'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45" returned: 0 in 0.547s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:35 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45 Nov 06 21:35:35 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:35 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-22b75bba-71de-473a-bda0-548a3debbb45" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-22b75bba-71de-473a-bda0-548a3debbb45" released by "delete_volume" :: held 0.914s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:35 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.528s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc Nov 06 21:35:35 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.315s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:35 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Deleted volume successfully. Nov 06 21:35:35 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['6ecc9c26-00a6-4188-9370-5e2c43175e67', '9be15b28-9a68-44a2-aecc-fb3a92de6e7d', 'e90afa89-5343-4bb6-8722-5a840b128472', '03ba1281-e01d-4f72-8b1e-c40bd920449b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-5f387579-ba7a-403d-ba8b-fca3ec530130 tempest-CreateVolumesFromSnapshotTest-1007878199 None] Lock "cinder-b3f69e6c-0f65-4cf0-b41b-5da4653485ba-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:36 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:36 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:36 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.272s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7b78bdaa-6fb0-443a-bfbd-aa23c484610e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-22b75bba-71de-473a-bda0-548a3debbb45-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[de54c710-8ccb-4fc4-b661-4f56a8902c12]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 Nov 06 21:35:37 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" returned: 0 in 0.890s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:38 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6 Nov 06 21:35:38 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.533s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:35:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:35:39 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" returned: 0 in 0.729s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6" released by "delete_volume" :: held 1.747s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['417ec51d-a981-499e-b6dd-509855732971', '562e1faa-e676-4bbd-aff8-0f4068920e80', '3600563d-b87f-4ffe-ba67-f9fa7f6e074e', '9e27cf9f-49e8-4d7e-b4ac-d8de7942ac77'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:39 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-4975f5a6-beb0-4ff9-b217-125ce2e8246c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-4975f5a6-beb0-4ff9-b217-125ce2e8246c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-4975f5a6-beb0-4ff9-b217-125ce2e8246c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-4975f5a6-beb0-4ff9-b217-125ce2e8246c" acquired by "delete_volume" :: waited 0.037s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd32e35-f9f1-4636-9fdd-3b3b7beb8eee]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.659s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:40 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:40 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7475a17b-bf59-4fda-904f-c35660d69e07 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-ba7b5b74-bbdc-4315-a2e5-4c5a606946e6-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:40 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c Nov 06 21:35:40 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c" returned: 0 in 1.126s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c Nov 06 21:35:41 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-4975f5a6-beb0-4ff9-b217-125ce2e8246c" returned: 0 in 0.631s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-4975f5a6-beb0-4ff9-b217-125ce2e8246c" released by "delete_volume" :: held 1.900s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:41 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['1d6859a7-9596-49a1-8c26-164cc2fd3ffc', '1bddd742-3044-41e3-a4b8-4509605f60ae', '16c4ac92-dc8c-4dc4-ae59-6938ba935bdb', '733b89eb-144a-436b-bc2f-27267f70aec1'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:42 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-3090e346-ebd5-4bd9-b2b2-36b201da66a2-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-3090e346-ebd5-4bd9-b2b2-36b201da66a2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "cinder-quobyte-3090e346-ebd5-4bd9-b2b2-36b201da66a2" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-3090e346-ebd5-4bd9-b2b2-36b201da66a2" acquired by "delete_volume" :: waited 0.040s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64d79bf-8eab-4d97-9ea6-1705a7b7a77e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 Nov 06 21:35:42 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:42 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.921s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d2761d48-b221-4864-9314-0a361b11149e tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-4975f5a6-beb0-4ff9-b217-125ce2e8246c-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:43 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2" returned: 0 in 0.740s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:43 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2 Nov 06 21:35:43 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-3090e346-ebd5-4bd9-b2b2-36b201da66a2" returned: 0 in 0.451s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-quobyte-3090e346-ebd5-4bd9-b2b2-36b201da66a2" released by "delete_volume" :: held 1.329s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Created reservations ['6ccc2ab0-9a27-461e-98bf-1b33eec171b3', '9f29da0c-1be0-43e7-b07b-ff8ec36e7f7c', '15d997cb-8700-4463-ad3e-bdaad70b2456', 'c50f4889-bcdb-4b67-b463-db5211ef5e72'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:44 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.496s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:44 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Deleted volume successfully. Nov 06 21:35:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c0d66734-bf1a-4e96-9581-acfd05b3b057 tempest-CreateVolumesFromSourceVolumeTest-1583892479 None] Lock "cinder-3090e346-ebd5-4bd9-b2b2-36b201da66a2-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-6fd5b2bb-c247-4a7d-95aa-11cf5fd94327 tempest-ProjectAdminTests-306167708 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87230) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:35:45 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc" returned: 0 in 9.704s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:35:45 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Converted 1024.00 MB image at 105.51 MB/s Nov 06 21:35:45 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc is being set with open permissions: ugo+rw Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:45 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc Nov 06 21:35:45 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:45 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" released by "_copy_volume_from_snapshot" :: held 11.189s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4-961ff0f9-29a9-4868-83d2-a0476bd159dc" released by "_create_volume_from_snapshot" :: held 11.310s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.343s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c99c1fb-01c5-4ca3-984b-d00ab245013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961ff0f9-29a9-4868-83d2-a0476bd159dc', 'volume_size': 1, 'snapshot_id': '402157df-6ec9-458d-a849-9cd9275cc8e4'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b806bae-1a68-4525-a89a-20d4801c88c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Volume volume-961ff0f9-29a9-4868-83d2-a0476bd159dc (961ff0f9-29a9-4868-83d2-a0476bd159dc): created successfully Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b806bae-1a68-4525-a89a-20d4801c88c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Flow 'volume_create_manager' (e02c11e2-6a17-4cf5-a823-81cd213b4009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-943b420e-2cd5-4914-94d8-3ccc8a13fb6d tempest-VolumeDependencyTests-951846362 None] Created volume successfully. Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-402157df-6ec9-458d-a849-9cd9275cc8e4-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-402157df-6ec9-458d-a849-9cd9275cc8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Deleting offline snapshot 402157df-6ec9-458d-a849-9cd9275cc8e4 of volume 7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] snapshot_file for this snap is: volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f8a4e-f253-43b0-a1db-9588fa10d2cf]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:47 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:47 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:47 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.518s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[396e03ba-32af-4146-97da-eba971a800d6]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:48 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:48 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:48 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.655s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:48 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:48 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.510s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:49 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4 Nov 06 21:35:49 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6.402157df-6ec9-458d-a849-9cd9275cc8e4" returned: 0 in 0.513s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-402157df-6ec9-458d-a849-9cd9275cc8e4" released by "_delete_snapshot" :: held 2.354s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" released by "delete_snapshot" :: held 2.381s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Created reservations ['460280ac-8e03-4b81-88fb-e97b744c8a63', '80bf26e2-f6ff-41f1-9c33-bbcb0c626f91', '7d81f99e-832f-4b21-8254-91435229122a', '5a19dd79-b634-44d1-aac7-69c1148603ca'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Delete snapshot completed successfully. Nov 06 21:35:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-099515c5-c6ab-46d4-820e-16973ac1e55f tempest-VolumeDependencyTests-951846362 None] Lock "cinder-402157df-6ec9-458d-a849-9cd9275cc8e4-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "cinder-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" acquired by "delete_volume" :: waited 0.024s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1b66c-2082-4e4e-aaa8-a85ad5453aed]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:50 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:50 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:51 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.450s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:51 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6 Nov 06 21:35:51 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:51 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6" released by "delete_volume" :: held 0.873s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Created reservations ['b82506db-cd6c-46a2-a14d-fba3abf9f6e6', '3f617ed9-d282-4c01-9d3f-1346007a7eb2', 'dafc17a8-925e-421a-98a7-6c99d2fca177', 'f02055fe-0a4a-4296-9a90-92097ad88918'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:51 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:51 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.338s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Deleted volume successfully. Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-1b7131dd-e249-4971-bbc4-7ad25f88abb5 tempest-VolumeDependencyTests-951846362 None] Lock "cinder-7f9f5a32-db0c-47b4-95e2-45a5aa6e3fd6-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-961ff0f9-29a9-4868-83d2-a0476bd159dc-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "cinder-961ff0f9-29a9-4868-83d2-a0476bd159dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Acquiring lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36d9ff7-6e4a-4f0b-a8a8-1a0c67438aec]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc Nov 06 21:35:52 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Flow 'volume_create_manager' (79de72a3-709f-4b1a-9ee1-a87144edd266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c3b2d7-9ccf-4111-93f9-a10854710796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c3b2d7-9ccf-4111-93f9-a10854710796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ce25e0-10e9-4663-9ec2-758b28755773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad37cb387b443baa5a0e5ad5c5db1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:53Z,use_quota=True,user_id='4f33fc1f8dda45ebaa674daabe4cd74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9db3531-5902-42bb-816d-e467fb4f706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9db3531-5902-42bb-816d-e467fb4f706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138cdcad-a7f5-428e-87f3-41838fccaed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87230]: DEBUG cinder.image.glance [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Creating Keystone auth plugin from conf {{(pid=87230) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:35:53 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc" returned: 0 in 0.546s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc Nov 06 21:35:53 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-961ff0f9-29a9-4868-83d2-a0476bd159dc" returned: 0 in 0.316s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "cinder-quobyte-961ff0f9-29a9-4868-83d2-a0476bd159dc" released by "delete_volume" :: held 0.936s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138cdcad-a7f5-428e-87f3-41838fccaed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94ce25e0-10e9-4663-9ec2-758b28755773', 'volume_name': 'volume-94ce25e0-10e9-4663-9ec2-758b28755773', 'volume_size': 1, 'image_id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f9ce64d54a8127253bd27876737e4a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ad37cb387b443baa5a0e5ad5c5db1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21af99f20cc70de70c7d9461ce6166c0afcfde4bbc821a78abc5ae6d8d42901317894a4e6eacad4b6b7d9c0a92fc26cb55c86a9884729c876efc3b145244f237', 'id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03496c27-bd92-478b-874f-e05b3e3994f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03496c27-bd92-478b-874f-e05b3e3994f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d295a4-512d-4ccb-bf62-7922f361a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Volume 94ce25e0-10e9-4663-9ec2-758b28755773: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94ce25e0-10e9-4663-9ec2-758b28755773', 'volume_size': 1, 'image_id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f9ce64d54a8127253bd27876737e4a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ad37cb387b443baa5a0e5ad5c5db1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21af99f20cc70de70c7d9461ce6166c0afcfde4bbc821a78abc5ae6d8d42901317894a4e6eacad4b6b7d9c0a92fc26cb55c86a9884729c876efc3b145244f237', 'id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb/file', 'properties': {}}, 'image_service': } Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Trying to clone 94ce25e0-10e9-4663-9ec2-758b28755773 from image caca5914-67d9-40a0-a5dc-511ea3fef9eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}]). {{(pid=87230) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Created reservations ['804c131c-ddcf-4cf0-b27f-a4a820a6e2a6', '68662dee-acfb-4826-a1ee-c3da3ece3d8e', '7d127fc4-9591-4ff9-ada4-3684d8177f81', '18d3d318-ddc7-4eaa-8641-37176104f57b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:35:53 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb33eec-e191-4f6f-9fc7-d01e938696ab]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:35:53 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:53 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Deleted volume successfully. Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-97f11f1a-72ba-41df-baab-5ca326e38edf tempest-VolumeDependencyTests-951846362 None] Lock "cinder-961ff0f9-29a9-4868-83d2-a0476bd159dc-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:54 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:54 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Temporary image caca5914-67d9-40a0-a5dc-511ea3fef9eb is fetched for user 4f33fc1f8dda45ebaa674daabe4cd74f. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2135807c-36ce-42fa-acd9-821886988d83]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:54 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:55 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ce25e0-10e9-4663-9ec2-758b28755773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad37cb387b443baa5a0e5ad5c5db1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:53Z,use_quota=True,user_id='4f33fc1f8dda45ebaa674daabe4cd74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Creating volume 94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:55 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1073741824 Nov 06 21:35:55 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1073741824" returned: 0 in 0.630s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=255,cinder:SELECT=193,cinder:INSERT=75,cinder:DELETE=19 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 Nov 06 21:35:56 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=191,cinder:UPDATE=279,cinder:DELETE=28,cinder:INSERT=62 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Attempting download of caca5914-67d9-40a0-a5dc-511ea3fef9eb ((None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}])) to volume 94ce25e0-10e9-4663-9ec2-758b28755773. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16653d-9482-4c99-b0a8-50327258633b]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d Nov 06 21:35:56 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:57 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:57 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d Nov 06 21:35:57 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:57 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d" returned: 1 in 0.478s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caca5914-67d9-40a0-a5dc-511ea3fef9eb_is8u0l8d' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa483e0-6509-4f56-be3b-cf841e2ee25a]: (4, 'raw') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:57 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:57 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD Nov 06 21:35:58 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] caca5914-67d9-40a0-a5dc-511ea3fef9eb was raw, converting to qcow2 {{(pid=87230) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 Nov 06 21:35:58 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (4983df86-3c24-4dd9-af28-50022ea781ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e3e4e-54ca-4965-bae4-8c7f8343ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e3e4e-54ca-4965-bae4-8c7f8343ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833559211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc2ce1a-3f39-4588-8699-c04f851e68fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:59Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11813d77-ebaf-4a87-9738-92d4910085f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11813d77-ebaf-4a87-9738-92d4910085f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10eeae9c-50b3-4a43-a6d4-56e228756d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10eeae9c-50b3-4a43-a6d4-56e228756d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc2ce1a-3f39-4588-8699-c04f851e68fb', 'volume_name': 'volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59bf57-641a-4239-b4dc-8bfc5a27b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59bf57-641a-4239-b4dc-8bfc5a27b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38cfdff-b7dd-4471-a679-e79496702712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Volume 5fc2ce1a-3f39-4588-8699-c04f851e68fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb', 'volume_size': 1} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833559211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc2ce1a-3f39-4588-8699-c04f851e68fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:59Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Creating volume 5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:58 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:35:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb 1073741824 Nov 06 21:35:58 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773" returned: 0 in 0.788s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_caca5914-67d9-40a0-a5dc-511ea3fef9eb_npmxt8wodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:35:59 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1G Nov 06 21:35:59 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb 1073741824" returned: 0 in 0.639s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb Nov 06 21:35:59 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 1G" returned: 0 in 0.495s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Downloaded image caca5914-67d9-40a0-a5dc-511ea3fef9eb ((None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}])) to volume 94ce25e0-10e9-4663-9ec2-758b28755773 successfully. {{(pid=87230) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Temporary image caca5914-67d9-40a0-a5dc-511ea3fef9eb for user 4f33fc1f8dda45ebaa674daabe4cd74f is deleted. {{(pid=87230) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.volume_utils [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Marking volume 94ce25e0-10e9-4663-9ec2-758b28755773 as bootable. {{(pid=87230) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Copying metadata from image caca5914-67d9-40a0-a5dc-511ea3fef9eb to 94ce25e0-10e9-4663-9ec2-758b28755773. {{(pid=87230) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Creating volume glance metadata for volume 94ce25e0-10e9-4663-9ec2-758b28755773 backed by image caca5914-67d9-40a0-a5dc-511ea3fef9eb with: {'image_id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9f9ce64d54a8127253bd27876737e4a5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87230) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d295a4-512d-4ccb-bf62-7922f361a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ce25e0-10e9-4663-9ec2-758b28755773', 'volume_size': 1, 'image_id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f9ce64d54a8127253bd27876737e4a5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ad37cb387b443baa5a0e5ad5c5db1d0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21af99f20cc70de70c7d9461ce6166c0afcfde4bbc821a78abc5ae6d8d42901317894a4e6eacad4b6b7d9c0a92fc26cb55c86a9884729c876efc3b145244f237', 'id': 'caca5914-67d9-40a0-a5dc-511ea3fef9eb', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caca5914-67d9-40a0-a5dc-511ea3fef9eb/file', 'properties': {}}, 'image_service': }' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91653d92-c8fb-4144-8c67-c4294e3c7a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:59 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb" returned: 0 in 0.378s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Volume volume-94ce25e0-10e9-4663-9ec2-758b28755773 (94ce25e0-10e9-4663-9ec2-758b28755773): created successfully Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91653d92-c8fb-4144-8c67-c4294e3c7a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Flow 'volume_create_manager' (79de72a3-709f-4b1a-9ee1-a87144edd266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38cfdff-b7dd-4471-a679-e79496702712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80c343a-4840-45ef-9ee4-908f50a2a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cc6272e6-4045-4d75-a3dc-f180daece2d5 tempest-VolumeImageDependencyTests-1272739164 None] Created volume successfully. Nov 06 21:36:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Volume volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb (5fc2ce1a-3f39-4588-8699-c04f851e68fb): created successfully Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80c343a-4840-45ef-9ee4-908f50a2a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (4983df86-3c24-4dd9-af28-50022ea781ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-08006fce-ea81-49d9-ad8b-3243d15d8296 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Acquiring lock "cinder-94ce25e0-10e9-4663-9ec2-758b28755773-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "cinder-94ce25e0-10e9-4663-9ec2-758b28755773-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Acquiring lock "cinder-quobyte-94ce25e0-10e9-4663-9ec2-758b28755773" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "cinder-quobyte-94ce25e0-10e9-4663-9ec2-758b28755773" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d8762-29d3-4e14-bfe2-6fea79ec9fd3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:00 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 Nov 06 21:36:00 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773" returned: 0 in 0.499s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:01 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773 Nov 06 21:36:01 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 5c26684b-69da-4398-89a6-12d68d56e0ff of volume 5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f164d4-95fa-421d-b41b-8d90f3b1eb26]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb Nov 06 21:36:01 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-94ce25e0-10e9-4663-9ec2-758b28755773" returned: 0 in 0.410s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "cinder-quobyte-94ce25e0-10e9-4663-9ec2-758b28755773" released by "delete_volume" :: held 0.982s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Created reservations ['cd0d1f0b-7564-468e-bc07-c24ff0fde100', 'ebe60e07-c28d-4655-9c0f-19968f25b09f', '50fe116a-d222-4fd7-a148-b148bc8bc1a2', 'e4ce2fb4-3353-4fad-a822-39cba1d045ef'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:01 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb" returned: 0 in 0.460s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff 1G Nov 06 21:36:01 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:01 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:01 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.525s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Deleted volume successfully. Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-b98f26cd-f72c-440d-b6c8-013e3035dcdf tempest-VolumeImageDependencyTests-1272739164 None] Lock "cinder-94ce25e0-10e9-4663-9ec2-758b28755773-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:02 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff 1G" returned: 0 in 0.763s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff Nov 06 21:36:02 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:02 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff" returned: 0 in 0.442s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff is being set with open permissions: ugo+rw Nov 06 21:36:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:02 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff Nov 06 21:36:02 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff" returned: 0 in 0.399s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:03 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info Nov 06 21:36:03 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:03 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info" returned: 0 in 0.317s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:03 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info is being set with open permissions: ugo+rw Nov 06 21:36:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:03 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info Nov 06 21:36:03 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:04 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.info" returned: 0 in 0.314s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d28e804d-573b-479f-a7be-51cc8d6d92f6 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-5c26684b-69da-4398-89a6-12d68d56e0ff-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-5c26684b-69da-4398-89a6-12d68d56e0ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-5c26684b-69da-4398-89a6-12d68d56e0ff" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5c26684b-69da-4398-89a6-12d68d56e0ff" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 5c26684b-69da-4398-89a6-12d68d56e0ff of volume 5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1eaad-51a2-4023-89fe-c09554fa8764]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:04 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff Nov 06 21:36:04 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Flow 'volume_create_manager' (5b3dad9e-a2d3-4957-ae6d-50635b17e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3f6d89-7281-496e-b907-ddc5109c78d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3f6d89-7281-496e-b907-ddc5109c78d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-435684395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c93ba8362e4878ad3f847ec7c73d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:05Z,use_quota=True,user_id='8c542de3d57048628e200ecbcd936052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ba7b76-36f7-4d7f-bc34-a6a374b3f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ba7b76-36f7-4d7f-bc34-a6a374b3f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d41b3f5-f111-4afa-a1e4-df0431398939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d41b3f5-f111-4afa-a1e4-df0431398939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7', 'volume_name': 'volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2871a793-2a63-4267-b85c-f5995953759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2871a793-2a63-4267-b85c-f5995953759a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d274d25b-b0a3-43eb-b0b9-cc39e199ce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:04 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Volume 1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7', 'volume_size': 1} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-435684395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c93ba8362e4878ad3f847ec7c73d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:05Z,use_quota=True,user_id='8c542de3d57048628e200ecbcd936052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Creating volume 1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:04 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:04 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 1073741824 Nov 06 21:36:04 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff" returned: 0 in 0.615s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50bb88-2053-4044-a38b-1a6022fb2f16]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb Nov 06 21:36:05 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 1073741824" returned: 0 in 0.637s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:05 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb" returned: 0 in 0.511s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:05 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff Nov 06 21:36:05 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:05 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.306s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d274d25b-b0a3-43eb-b0b9-cc39e199ce69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184bbf43-30a4-489c-ac12-d2f6f9279faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:05 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Volume volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 (1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7): created successfully Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184bbf43-30a4-489c-ac12-d2f6f9279faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:05 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Flow 'volume_create_manager' (5b3dad9e-a2d3-4957-ae6d-50635b17e93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:05 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-27e96b47-3a9d-43e6-a91c-3afa6278d2dd tempest-SnapshotDependencyTests-836464602 None] Created volume successfully. Nov 06 21:36:06 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff" returned: 0 in 0.416s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:06 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff Nov 06 21:36:06 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:06 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb.5c26684b-69da-4398-89a6-12d68d56e0ff" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5c26684b-69da-4398-89a6-12d68d56e0ff" released by "_delete_snapshot" :: held 1.999s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" released by "delete_snapshot" :: held 2.035s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Created reservations ['cd4af1ba-c1ac-4c98-8821-e2509357f8ac', 'f31ea676-70c0-4f27-b44b-749391896093', '7d344a04-bc0e-41fa-b6c9-9e941badf73a', 'b76ac99c-ccce-4177-a4b2-9753be36a015'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-68e9b1bd-fa72-4fa1-995d-94709c403386 tempest-ProjectMemberTests-551412650 None] Lock "cinder-5c26684b-69da-4398-89a6-12d68d56e0ff-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Creating offline snapshot 30984b1a-f59a-4dde-811e-df87461fd960 of volume 1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0392dce-d9d4-4717-92a2-9dac86bf5d88]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:07 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-5fc2ce1a-3f39-4588-8699-c04f851e68fb-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "cinder-5fc2ce1a-3f39-4588-8699-c04f851e68fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:07 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.492s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93942a0-5e5b-4514-bf7b-dd0c684b2fea]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 1G Nov 06 21:36:07 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb Nov 06 21:36:08 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb" returned: 0 in 0.406s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb Nov 06 21:36:08 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 1G" returned: 0 in 0.559s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:08 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5fc2ce1a-3f39-4588-8699-c04f851e68fb" returned: 0 in 0.383s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-5fc2ce1a-3f39-4588-8699-c04f851e68fb" released by "delete_volume" :: held 0.915s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Created reservations ['1ad8b725-5d38-4b70-a296-636e5c2587d6', '84817ed0-0885-4849-943a-0bc3afcb6da8', '05df4abd-cbab-4b47-aeb4-6680758a8371', 'ee1e9975-9472-420a-91b6-217f0bb43a7e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:08 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.501s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 is being set with open permissions: ugo+rw Nov 06 21:36:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:09 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:09 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info Nov 06 21:36:09 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.487s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:09 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-fd919475-a85c-42ec-9ebc-add66e72b745 tempest-ProjectMemberTests-551412650 None] Lock "cinder-5fc2ce1a-3f39-4588-8699-c04f851e68fb-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:09 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info" returned: 0 in 0.440s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info is being set with open permissions: ugo+rw Nov 06 21:36:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info Nov 06 21:36:09 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.info" returned: 0 in 0.339s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.833s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e992fc0a-8d27-4606-b4de-188bab2c7d1b tempest-SnapshotDependencyTests-836464602 None] Create snapshot completed successfully Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (dcf7d4a8-da6d-4375-b9af-caa0be7851ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81243cad-086d-4d1c-a7aa-28273972c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81243cad-086d-4d1c-a7aa-28273972c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575030227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb3db1-1cb1-4221-b0f0-bf5b71a4355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:10Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062b2a9c-1fc4-4043-b770-145d575527b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062b2a9c-1fc4-4043-b770-145d575527b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4b5de0-2f00-420e-860e-1de32592d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4b5de0-2f00-420e-860e-1de32592d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afb3db1-1cb1-4221-b0f0-bf5b71a4355c', 'volume_name': 'volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c64795-78cc-41b4-b268-a8ad47bffbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c64795-78cc-41b4-b268-a8ad47bffbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca69b74-4634-4a78-a1d3-0d79d9252075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:10 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Volume 6afb3db1-1cb1-4221-b0f0-bf5b71a4355c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c', 'volume_size': 1} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575030227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afb3db1-1cb1-4221-b0f0-bf5b71a4355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:10Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Creating volume 6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:10 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c 1073741824 Nov 06 21:36:10 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c 1073741824" returned: 0 in 0.468s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c Nov 06 21:36:10 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" returned: 0 in 0.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca69b74-4634-4a78-a1d3-0d79d9252075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbeb744-b6bb-4879-b20a-e466e106c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Volume volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c (6afb3db1-1cb1-4221-b0f0-bf5b71a4355c): created successfully Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbeb744-b6bb-4879-b20a-e466e106c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (dcf7d4a8-da6d-4375-b9af-caa0be7851ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7bd32ee1-8785-4186-a79e-df5380af25f0 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Flow 'volume_create_manager' (d181835c-2114-4457-acd7-3ef70ce3aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9691aeec-9527-4b63-8bae-a72da1bbafde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9691aeec-9527-4b63-8bae-a72da1bbafde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca27638d-36f5-4ae1-8916-c8ae29a3d15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c93ba8362e4878ad3f847ec7c73d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30984b1a-f59a-4dde-811e-df87461fd960,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:12Z,use_quota=True,user_id='8c542de3d57048628e200ecbcd936052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d56b98-7739-4cd4-8a51-739cc341200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d56b98-7739-4cd4-8a51-739cc341200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cf7301-ab4f-4ed2-bbd7-4c0a0267c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cf7301-ab4f-4ed2-bbd7-4c0a0267c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca27638d-36f5-4ae1-8916-c8ae29a3d15b', 'volume_name': 'volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b', 'volume_size': 1, 'snapshot_id': '30984b1a-f59a-4dde-811e-df87461fd960'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acdfd63-bb31-45fa-85a8-fdf0e904dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acdfd63-bb31-45fa-85a8-fdf0e904dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c39d36a-e1cd-479e-b2f5-98ff5858a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Volume ca27638d-36f5-4ae1-8916-c8ae29a3d15b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b', 'volume_size': 1, 'snapshot_id': '30984b1a-f59a-4dde-811e-df87461fd960'} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" by "_create_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Creating volume ca27638d-36f5-4ae1-8916-c8ae29a3d15b from snapshot 30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" by "_copy_volume_from_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] snapshot: 30984b1a-f59a-4dde-811e-df87461fd960, volume: ca27638d-36f5-4ae1-8916-c8ae29a3d15b, {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7f6d93-0c82-4759-bd07-629b02d8c18a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:12 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Flow 'volume_create_manager' (d361060e-dc8c-4cf8-8acf-17e49f278dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d6474-0fc4-4060-a1ea-93141918e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d6474-0fc4-4060-a1ea-93141918e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222372931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1d59d0-5baa-4fb1-b771-96cbbc432503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f90d4ee254be6aea561d710108f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:12Z,use_quota=True,user_id='e02d7c54795f426e976dee9afdefa0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3a6de-0892-4b90-b31a-a80ceeff891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a3a6de-0892-4b90-b31a-a80ceeff891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf51f96-3569-44da-a1e9-71cabcec4c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf51f96-3569-44da-a1e9-71cabcec4c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1d59d0-5baa-4fb1-b771-96cbbc432503', 'volume_name': 'volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e082270-ca0f-4c85-9956-39d4097d3146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e082270-ca0f-4c85-9956-39d4097d3146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cab5529-8145-4646-9042-6352dac94593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:12 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Volume 5c1d59d0-5baa-4fb1-b771-96cbbc432503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503', 'volume_size': 1} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:12 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.472s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c47a7e-205a-4e8d-9ea6-8d8cca22f979]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:12 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:12 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Creating direct copy from snapshot {{(pid=87230) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG cinder.utils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Path /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b not found in is_blk_device check {{(pid=87230) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:36:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b Nov 06 21:36:12 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:19 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" returned: 0 in 7.102s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:19 devstack cinder-volume[87230]: DEBUG cinder.image.image_utils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Image conversion details: src /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b {{(pid=87230) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:19 devstack cinder-volume[87230]: INFO cinder.image.image_utils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Converted 1024.00 MB image at 144.16 MB/s Nov 06 21:36:19 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b is being set with open permissions: ugo+rw Nov 06 21:36:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:19 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b Nov 06 21:36:19 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:20 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" released by "_copy_volume_from_snapshot" :: held 8.337s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" released by "_create_volume_from_snapshot" :: held 8.432s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.454s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.064s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222372931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1d59d0-5baa-4fb1-b771-96cbbc432503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f90d4ee254be6aea561d710108f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:12Z,use_quota=True,user_id='e02d7c54795f426e976dee9afdefa0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Creating volume 5c1d59d0-5baa-4fb1-b771-96cbbc432503 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:20 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:20 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 1073741824 Nov 06 21:36:20 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c39d36a-e1cd-479e-b2f5-98ff5858a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b', 'volume_size': 1, 'snapshot_id': '30984b1a-f59a-4dde-811e-df87461fd960'}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c6559d-f536-4e34-94a9-78b26d69a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:20 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Volume volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b (ca27638d-36f5-4ae1-8916-c8ae29a3d15b): created successfully Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c6559d-f536-4e34-94a9-78b26d69a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Flow 'volume_create_manager' (d181835c-2114-4457-acd7-3ef70ce3aed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-540dc835-99ae-4ca8-8116-2fdf141ed4c2 tempest-SnapshotDependencyTests-836464602 None] Created volume successfully. Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-30984b1a-f59a-4dde-811e-df87461fd960-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-30984b1a-f59a-4dde-811e-df87461fd960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Deleting offline snapshot 30984b1a-f59a-4dde-811e-df87461fd960 of volume 1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] snapshot_file for this snap is: volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb0ad3f-41e9-4d87-9021-248bd490ddf3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:20 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:20 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:20 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 1073741824" returned: 0 in 0.567s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:20 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 Nov 06 21:36:20 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.366s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0bae21-955e-4669-bf0c-368e9147e7da]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.570s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cab5529-8145-4646-9042-6352dac94593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d33796e-93f6-450f-8db5-75c5b3663147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 1a355154-0649-4766-80cb-b012460f97a4 of volume 6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Volume volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 (5c1d59d0-5baa-4fb1-b771-96cbbc432503): created successfully Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d33796e-93f6-450f-8db5-75c5b3663147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Flow 'volume_create_manager' (d361060e-dc8c-4cf8-8acf-17e49f278dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18494df-3fc4-4f79-984e-44ec687b5dc9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:21 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-334c2175-fff7-47c0-9781-5cb67ea28513 tempest-ProjectReaderTests-326025416 None] Created volume successfully. Nov 06 21:36:21 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c Nov 06 21:36:21 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 1G Nov 06 21:36:21 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:21 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.610s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:21 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:21 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Acquiring lock "cinder-5c1d59d0-5baa-4fb1-b771-96cbbc432503-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "cinder-5c1d59d0-5baa-4fb1-b771-96cbbc432503-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:22 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Acquiring lock "cinder-quobyte-5c1d59d0-5baa-4fb1-b771-96cbbc432503" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.463s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "cinder-quobyte-5c1d59d0-5baa-4fb1-b771-96cbbc432503" acquired by "delete_volume" :: waited 0.031s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:22 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960 Nov 06 21:36:22 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 1G" returned: 0 in 0.594s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6dba7-701a-4a27-bda5-d4e2ba61361c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 Nov 06 21:36:22 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 Nov 06 21:36:22 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7.30984b1a-f59a-4dde-811e-df87461fd960" returned: 0 in 0.329s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-30984b1a-f59a-4dde-811e-df87461fd960" released by "_delete_snapshot" :: held 1.898s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" released by "delete_snapshot" :: held 1.942s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:22 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4" returned: 0 in 0.415s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 is being set with open permissions: ugo+rw Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Created reservations ['6caf87ab-2f96-4ed9-896e-05c28ccb2ebe', '29e0c895-4cd1-4e06-95c8-86dbc2599185', '5e1d314b-a6af-4632-99c9-5f253c133500', 'cd616f69-33b8-40d8-bfe2-9f98379e39dc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:22 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 Nov 06 21:36:22 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Delete snapshot completed successfully. Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2633dfae-f50a-4154-8a5b-74a7bbf7a45b tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-30984b1a-f59a-4dde-811e-df87461fd960-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:22 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503" returned: 0 in 0.555s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:22 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503 Nov 06 21:36:22 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:22 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c5cb04-bf11-40f7-af93-154ec1f256de]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info Nov 06 21:36:23 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-5c1d59d0-5baa-4fb1-b771-96cbbc432503" returned: 0 in 0.319s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "cinder-quobyte-5c1d59d0-5baa-4fb1-b771-96cbbc432503" released by "delete_volume" :: held 0.935s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Created reservations ['23ba80ae-f59c-4bef-a927-aa8ae063544e', '5f92481f-9e71-4d12-900a-8a962bae93c4', 'cf53d742-54ec-41cb-8b68-5a905092efe4', '99fe8239-fec0-4eed-ad41-5d3438d4b3cc'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info" returned: 0 in 0.291s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info is being set with open permissions: ugo+rw Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:23 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info Nov 06 21:36:23 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:23 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7 Nov 06 21:36:23 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:23 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.299s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Deleted volume successfully. Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-3e0ea099-7c63-473f-be67-0257e25579ec tempest-ProjectReaderTests-326025416 None] Lock "cinder-5c1d59d0-5baa-4fb1-b771-96cbbc432503-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:23 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.info" returned: 0 in 0.320s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7077564a-0bdb-4398-9a49-109ec50aa3c2 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:23 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" returned: 0 in 0.354s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7" released by "delete_volume" :: held 0.865s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Created reservations ['343b2ec6-b797-4b3b-926b-f3724a8704d5', '6ad27bbe-9a46-4234-8ce1-23ce736055ba', '61ef8980-ca43-4106-94fc-9a69131286b6', 'fa1f22b6-00dd-4219-b4ff-9dd99e8d735b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Flow 'volume_create_manager' (4737bd41-a91b-40e3-8543-6fcb7811a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:23 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cea568-a0db-432a-acd3-5d0f2a2b7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cea568-a0db-432a-acd3-5d0f2a2b7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823160779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5dc1481-b6af-4627-b0ee-d8a6bf5fed99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f90d4ee254be6aea561d710108f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='e02d7c54795f426e976dee9afdefa0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79100faf-32f5-466c-a010-43e8d4ee8b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79100faf-32f5-466c-a010-43e8d4ee8b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6ed96-f225-49d0-bad7-ac8b31030992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6ed96-f225-49d0-bad7-ac8b31030992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5dc1481-b6af-4627-b0ee-d8a6bf5fed99', 'volume_name': 'volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdf1dfa-8ee8-47aa-bf86-17fb719f0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdf1dfa-8ee8-47aa-bf86-17fb719f0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6205d48-f9a7-4446-878d-989e326da5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Volume e5dc1481-b6af-4627-b0ee-d8a6bf5fed99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99', 'volume_size': 1} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823160779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5dc1481-b6af-4627-b0ee-d8a6bf5fed99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f90d4ee254be6aea561d710108f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:24Z,use_quota=True,user_id='e02d7c54795f426e976dee9afdefa0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Creating volume e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-ca27638d-36f5-4ae1-8916-c8ae29a3d15b-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:24 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 1073741824 Nov 06 21:36:24 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-ca27638d-36f5-4ae1-8916-c8ae29a3d15b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-1a355154-0649-4766-80cb-b012460f97a4-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:24 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-1a355154-0649-4766-80cb-b012460f97a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-1a355154-0649-4766-80cb-b012460f97a4" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fdaa89-b260-4b1c-921e-c71e646fcf42]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-1a355154-0649-4766-80cb-b012460f97a4" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 1a355154-0649-4766-80cb-b012460f97a4 of volume 6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b769c-fbd1-43ec-9840-b5723a17ac1d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b Nov 06 21:36:24 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.379s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Deleted volume successfully. Nov 06 21:36:24 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d5f3e41b-ff28-4870-81b7-24048b561bfe tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-1b014cf2-2f64-4710-bb9c-d9d4f9fd7ed7-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:24 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 1073741824" returned: 0 in 0.643s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 Nov 06 21:36:24 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" returned: 0 in 0.494s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:24 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b Nov 06 21:36:24 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:24 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4" returned: 0 in 0.568s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[04785b99-1159-49a4-af75-09b57841d452]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" returned: 0 in 0.324s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6205d48-f9a7-4446-878d-989e326da5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38c730f-5d13-4697-a25f-c633bb496921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Volume volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 (e5dc1481-b6af-4627-b0ee-d8a6bf5fed99): created successfully Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38c730f-5d13-4697-a25f-c633bb496921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Flow 'volume_create_manager' (4737bd41-a91b-40e3-8543-6fcb7811a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0b57e94c-1697-45f0-9327-4e19ae865599 tempest-ProjectReaderTests-326025416 None] Created volume successfully. Nov 06 21:36:25 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-quobyte-ca27638d-36f5-4ae1-8916-c8ae29a3d15b" released by "delete_volume" :: held 0.896s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Created reservations ['4eea8a77-4ad7-4b41-b028-7731cad59e3b', '61ee3693-e534-42ab-971d-cc955f4e1aa0', '94a27439-c495-49b8-9102-212d38593a64', '2c2a7176-f4d3-4614-846c-23da17ba7c6b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:25 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" returned: 0 in 0.435s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 Nov 06 21:36:25 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Deleted volume successfully. Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-446e596a-ff4b-49c6-ace9-54c267b1d0c5 tempest-SnapshotDependencyTests-836464602 None] Lock "cinder-ca27638d-36f5-4ae1-8916-c8ae29a3d15b-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:25 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4" returned: 0 in 0.435s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:25 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4 Nov 06 21:36:25 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Acquiring lock "cinder-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "cinder-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Acquiring lock "cinder-quobyte-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "cinder-quobyte-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570c4ac-7e92-4c9b-bb1e-c0f98934499f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c.1a355154-0649-4766-80cb-b012460f97a4" returned: 0 in 0.321s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 Nov 06 21:36:26 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-1a355154-0649-4766-80cb-b012460f97a4" released by "_delete_snapshot" :: held 1.929s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" released by "delete_snapshot" :: held 1.983s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Created reservations ['813094c6-1884-4ae8-abb2-e16d650418cb', '021e99c2-ae0a-4f6b-951a-ad72e222783e', '42fce81a-ab62-4693-bf1b-1e1289bd958a', '351b1579-ad59-4fb2-ae39-4e8e8847e66b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-219f4f88-56db-4837-990d-c300d35021b3 tempest-ProjectMemberTests-551412650 None] Lock "cinder-1a355154-0649-4766-80cb-b012460f97a4-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:26 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" returned: 0 in 0.458s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99 Nov 06 21:36:26 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:26 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" returned: 0 in 0.278s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "cinder-quobyte-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99" released by "delete_volume" :: held 0.801s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:26 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Created reservations ['4398469d-2216-48f6-856a-dc6a2191be53', '4eef487d-bcbd-4c6d-9453-d104a45eb61e', 'bdc4dba0-19af-4d29-a4a0-6f350fd99a36', '94d8c468-5db6-465b-a43c-cc4e86dfd094'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:27 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:27 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:27 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.307s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Deleted volume successfully. Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-81b5d1e7-d664-4116-a693-d0abfa713281 tempest-ProjectReaderTests-326025416 None] Lock "cinder-e5dc1481-b6af-4627-b0ee-d8a6bf5fed99-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "cinder-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" acquired by "delete_volume" :: waited 0.027s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[84054f3e-3250-4a21-b258-f5b2ed237c17]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:27 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c Nov 06 21:36:27 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" returned: 0 in 0.423s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c Nov 06 21:36:28 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" returned: 0 in 0.287s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c" released by "delete_volume" :: held 0.795s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Created reservations ['2107d96c-e1ab-42c8-91ac-d7e8a1e9a27b', 'f8c6d6a7-3278-4f2c-875e-451f6c8453fd', '468e5f36-cc68-4aa3-b6b3-408429762597', '25188380-8f43-481a-a00f-62d550047ae6'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:28 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.269s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:28 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8470af30-d07a-48ca-8e98-15e83cc42770 tempest-ProjectMemberTests-551412650 None] Lock "cinder-6afb3db1-1cb1-4221-b0f0-bf5b71a4355c-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (7cbe498c-19c2-4abd-b85e-0dbc0b7dc7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2c3832-f181-4ff9-826f-05edac67072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2c3832-f181-4ff9-826f-05edac67072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443221799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83474c4f-387c-4680-9e55-0dca91a2c483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:29Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ff336-0511-4d24-84f8-e9b6f93e6e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ff336-0511-4d24-84f8-e9b6f93e6e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacae51b-df8f-4f57-b56d-550bd48b40e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacae51b-df8f-4f57-b56d-550bd48b40e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83474c4f-387c-4680-9e55-0dca91a2c483', 'volume_name': 'volume-83474c4f-387c-4680-9e55-0dca91a2c483', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda30589-3460-46f5-bfb9-dcc60d238b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda30589-3460-46f5-bfb9-dcc60d238b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6deb6e2-e9fd-45a6-a3e7-ede4ed8bbffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:29 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Volume 83474c4f-387c-4680-9e55-0dca91a2c483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83474c4f-387c-4680-9e55-0dca91a2c483', 'volume_size': 1} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443221799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83474c4f-387c-4680-9e55-0dca91a2c483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:29Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Creating volume 83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:29 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 1073741824 Nov 06 21:36:29 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 1073741824" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 Nov 06 21:36:29 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483" returned: 0 in 0.242s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6deb6e2-e9fd-45a6-a3e7-ede4ed8bbffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83474c4f-387c-4680-9e55-0dca91a2c483', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad460f44-2e3f-47ba-8660-9d13af5e4813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:30 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Volume volume-83474c4f-387c-4680-9e55-0dca91a2c483 (83474c4f-387c-4680-9e55-0dca91a2c483): created successfully Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad460f44-2e3f-47ba-8660-9d13af5e4813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:30 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (7cbe498c-19c2-4abd-b85e-0dbc0b7dc7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:30 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2f6351de-8a7a-4865-b9e6-e3d2e9518a7d tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 2a6302d3-412d-412c-8c6b-439e6383bce4 of volume 83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:31 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1e9e8-e1b7-467c-90f3-d8793dcbff6e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 Nov 06 21:36:31 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483" returned: 0 in 0.457s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 1G Nov 06 21:36:32 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 1G" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83474c4f-387c-4680-9e55-0dca91a2c483 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83474c4f-387c-4680-9e55-0dca91a2c483 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 Nov 06 21:36:32 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83474c4f-387c-4680-9e55-0dca91a2c483 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 is being set with open permissions: ugo+rw Nov 06 21:36:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 Nov 06 21:36:32 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info Nov 06 21:36:33 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info is being set with open permissions: ugo+rw Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info Nov 06 21:36:33 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.info" returned: 0 in 0.288s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:33 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-3fb81833-be1e-4eab-ab64-d738e83655dc tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-2a6302d3-412d-412c-8c6b-439e6383bce4-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-2a6302d3-412d-412c-8c6b-439e6383bce4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-2a6302d3-412d-412c-8c6b-439e6383bce4" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2a6302d3-412d-412c-8c6b-439e6383bce4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 2a6302d3-412d-412c-8c6b-439e6383bce4 of volume 83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc1c42-f523-4f78-a868-79df62c3ce8f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 Nov 06 21:36:34 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83474c4f-387c-4680-9e55-0dca91a2c483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1744e75-a695-4621-b2cc-744aaaf0e965]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 Nov 06 21:36:35 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483" returned: 0 in 0.453s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 Nov 06 21:36:35 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4" returned: 0 in 0.399s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4 Nov 06 21:36:36 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483.2a6302d3-412d-412c-8c6b-439e6383bce4" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2a6302d3-412d-412c-8c6b-439e6383bce4" released by "_delete_snapshot" :: held 1.632s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" released by "delete_snapshot" :: held 1.657s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Created reservations ['700988a5-b77d-404d-8aeb-cc314f7d77b9', 'fe52e3d4-eade-49e4-b84d-09493c6d7834', '81c48570-d31a-4835-a7a6-4b61c2f3eae3', '415d4886-7250-4d70-941b-f3fdef3535ca'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-c3569e65-b57c-4447-a11b-5a4713442dcd tempest-ProjectMemberTests-551412650 None] Lock "cinder-2a6302d3-412d-412c-8c6b-439e6383bce4-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-83474c4f-387c-4680-9e55-0dca91a2c483-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "cinder-83474c4f-387c-4680-9e55-0dca91a2c483-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a77d0e8-ceb2-4fae-a959-b2c4f130ac1e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 Nov 06 21:36:37 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483 Nov 06 21:36:37 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-83474c4f-387c-4680-9e55-0dca91a2c483" returned: 0 in 0.268s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-83474c4f-387c-4680-9e55-0dca91a2c483" released by "delete_volume" :: held 0.758s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Created reservations ['00154e6d-80f2-4ffa-9edd-c9fd67295bbd', '551a5549-a472-44e3-8195-af1de756fb20', '2df0867b-a5a9-4511-b829-66282536713e', '55333246-44d7-413e-9200-0eab9c63ce77'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:37 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:38 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:38 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-73df1c5b-1fd1-4d3c-abc3-b9dcd7ad0e40 tempest-ProjectMemberTests-551412650 None] Lock "cinder-83474c4f-387c-4680-9e55-0dca91a2c483-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:38 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.316s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (f5bddafb-4def-4147-9a4a-1001bef1d323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d723e403-24c3-47f6-ab36-75fcd8900613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d723e403-24c3-47f6-ab36-75fcd8900613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079668476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228f56f2-90c1-4636-bd4a-f7d85f585609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:39Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9f5152-89d1-49a9-a909-6df995942b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9f5152-89d1-49a9-a909-6df995942b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bac665f-3888-434c-8ee5-f81094e9f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bac665f-3888-434c-8ee5-f81094e9f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228f56f2-90c1-4636-bd4a-f7d85f585609', 'volume_name': 'volume-228f56f2-90c1-4636-bd4a-f7d85f585609', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0af764-34ff-4f62-939e-9fda2cff208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0af764-34ff-4f62-939e-9fda2cff208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147394d-1cd7-4db7-871e-60bc1dcdcd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Volume 228f56f2-90c1-4636-bd4a-f7d85f585609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228f56f2-90c1-4636-bd4a-f7d85f585609', 'volume_size': 1} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079668476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228f56f2-90c1-4636-bd4a-f7d85f585609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:39Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Creating volume 228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:38 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 1073741824 Nov 06 21:36:38 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 1073741824" returned: 0 in 0.426s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 Nov 06 21:36:39 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609" returned: 0 in 0.256s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147394d-1cd7-4db7-871e-60bc1dcdcd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228f56f2-90c1-4636-bd4a-f7d85f585609', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449761c-596f-4cd9-a349-3f6d03feeeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Volume volume-228f56f2-90c1-4636-bd4a-f7d85f585609 (228f56f2-90c1-4636-bd4a-f7d85f585609): created successfully Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c449761c-596f-4cd9-a349-3f6d03feeeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (f5bddafb-4def-4147-9a4a-1001bef1d323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-b891269e-3d24-4cb8-946b-9e4d9220f921 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Creating offline snapshot af5d379b-a201-404a-aa7a-93bf7e117d3a of volume 228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a59fb-5c1f-4579-a2cb-3ba70e600f08]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 Nov 06 21:36:39 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609" returned: 0 in 0.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a 1G Nov 06 21:36:40 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a 1G" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f56f2-90c1-4636-bd4a-f7d85f585609 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f56f2-90c1-4636-bd4a-f7d85f585609 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a Nov 06 21:36:40 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228f56f2-90c1-4636-bd4a-f7d85f585609 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a" returned: 0 in 0.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a is being set with open permissions: ugo+rw Nov 06 21:36:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a Nov 06 21:36:40 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info Nov 06 21:36:41 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info" returned: 0 in 0.259s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info is being set with open permissions: ugo+rw Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info Nov 06 21:36:41 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.info" returned: 0 in 0.239s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:41 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50acf721-279d-4c74-8b2d-96b36387560e tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-af5d379b-a201-404a-aa7a-93bf7e117d3a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-af5d379b-a201-404a-aa7a-93bf7e117d3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-af5d379b-a201-404a-aa7a-93bf7e117d3a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-af5d379b-a201-404a-aa7a-93bf7e117d3a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:41 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot af5d379b-a201-404a-aa7a-93bf7e117d3a of volume 228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec164f-ed5e-4a46-abb1-4a954e56c8ab]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a Nov 06 21:36:42 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a" returned: 0 in 0.375s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-228f56f2-90c1-4636-bd4a-f7d85f585609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[de669c0e-7912-4f61-8877-f13c188b8fbe]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 Nov 06 21:36:42 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609" returned: 0 in 0.362s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a Nov 06 21:36:42 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a" returned: 0 in 0.323s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a Nov 06 21:36:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609.af5d379b-a201-404a-aa7a-93bf7e117d3a" returned: 0 in 0.244s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-af5d379b-a201-404a-aa7a-93bf7e117d3a" released by "_delete_snapshot" :: held 1.407s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" released by "delete_snapshot" :: held 1.430s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Created reservations ['31da5ea3-aebd-4928-9eb5-3de0882cd368', '25cd637f-cd3b-45b1-a724-d9336359f01e', '9c55e17a-316a-4b84-a170-c1b005fbd6d8', 'b60bcdb7-5725-438c-8751-f76060f5200b'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-985fc7f1-be25-4229-9570-4c944d25f1a0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-af5d379b-a201-404a-aa7a-93bf7e117d3a-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-228f56f2-90c1-4636-bd4a-f7d85f585609-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "cinder-228f56f2-90c1-4636-bd4a-f7d85f585609-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b351616-c9e4-4cae-bf3e-4b8dbb04fa6e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 Nov 06 21:36:44 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609" returned: 0 in 0.382s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609 Nov 06 21:36:44 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-228f56f2-90c1-4636-bd4a-f7d85f585609" returned: 0 in 0.275s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-228f56f2-90c1-4636-bd4a-f7d85f585609" released by "delete_volume" :: held 0.723s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Created reservations ['630215b1-fddb-42cc-b82e-82d7fc319b66', '78af5cff-b21c-4ca4-814b-0f18a8d71931', 'e55b0d76-8125-4c2c-a726-046a1dec43c2', '16bc0eb3-1e70-4845-94e1-3d62a75b9d69'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:45 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:45 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.308s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d8e7b07c-592a-4310-9a43-ba91f104d3fc tempest-ProjectMemberTests-551412650 None] Lock "cinder-228f56f2-90c1-4636-bd4a-f7d85f585609-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (a71a6f44-624e-4446-8c67-db3f7a8fdfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac359b9-d2c1-4983-b090-1468613188a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac359b9-d2c1-4983-b090-1468613188a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929438765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe92c55-9f31-4dee-aa24-bf5d26cc38aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:46Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f030d205-67ab-47c5-b27b-401b6b27cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f030d205-67ab-47c5-b27b-401b6b27cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319734d2-d6e7-45fd-b135-bcb899cfb327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319734d2-d6e7-45fd-b135-bcb899cfb327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe92c55-9f31-4dee-aa24-bf5d26cc38aa', 'volume_name': 'volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63589e2a-a767-476f-9d05-6974824d74aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63589e2a-a767-476f-9d05-6974824d74aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d536e8-349a-4ddf-bb13-e4202c887e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:45 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Volume 2fe92c55-9f31-4dee-aa24-bf5d26cc38aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa', 'volume_size': 1} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929438765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe92c55-9f31-4dee-aa24-bf5d26cc38aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:46Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Creating volume 2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:45 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa 1073741824 Nov 06 21:36:45 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa 1073741824" returned: 0 in 0.421s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa Nov 06 21:36:46 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" returned: 0 in 0.243s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d536e8-349a-4ddf-bb13-e4202c887e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b9591a-0b98-4521-bce6-6bb94b03c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Volume volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa (2fe92c55-9f31-4dee-aa24-bf5d26cc38aa): created successfully Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b9591a-0b98-4521-bce6-6bb94b03c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (a71a6f44-624e-4446-8c67-db3f7a8fdfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a9d8eaf3-2415-4db9-8df5-f53e4f76d8d3 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot da4676f1-07f1-4652-9990-15accf7c3d4e of volume 2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f62ccd-8f0b-4fcb-8f1d-505cffbf5f9f]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa Nov 06 21:36:47 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:47 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e 1G Nov 06 21:36:47 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:47 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e 1G" returned: 0 in 0.401s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e Nov 06 21:36:47 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e" returned: 0 in 0.327s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e is being set with open permissions: ugo+rw Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e Nov 06 21:36:48 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e" returned: 0 in 0.264s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info Nov 06 21:36:48 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info" returned: 0 in 0.248s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info is being set with open permissions: ugo+rw Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info Nov 06 21:36:48 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.info" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:48 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-40ac3792-ca2b-49c6-bd26-2199ed5ab991 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-da4676f1-07f1-4652-9990-15accf7c3d4e-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-da4676f1-07f1-4652-9990-15accf7c3d4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-da4676f1-07f1-4652-9990-15accf7c3d4e" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-da4676f1-07f1-4652-9990-15accf7c3d4e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot da4676f1-07f1-4652-9990-15accf7c3d4e of volume 2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf05a7a-9e79-407f-800e-cab314048fb5]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e Nov 06 21:36:49 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e" returned: 0 in 0.366s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63a0f5-1d92-416b-b611-d691d196e07b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa Nov 06 21:36:49 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" returned: 0 in 0.358s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e Nov 06 21:36:49 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e Nov 06 21:36:50 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa.da4676f1-07f1-4652-9990-15accf7c3d4e" returned: 0 in 0.243s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-da4676f1-07f1-4652-9990-15accf7c3d4e" released by "_delete_snapshot" :: held 1.397s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" released by "delete_snapshot" :: held 1.423s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Created reservations ['bd9f2a21-9ff4-48dd-9e0d-08c1501d6f3e', 'bec6c4b1-3b06-4714-a886-aa643f60fa1b', '80ccb4d0-99fc-4846-ae0f-4eb76c9136ec', '5a6b93f6-886b-476e-9c97-eaa8c32adf68'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d454dbeb-1915-4ee9-bbe9-ced7566573f0 tempest-ProjectMemberTests-551412650 None] Lock "cinder-da4676f1-07f1-4652-9990-15accf7c3d4e-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "cinder-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b59b75-97f7-405a-b034-afb78900c967]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa Nov 06 21:36:51 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa Nov 06 21:36:51 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa" released by "delete_volume" :: held 0.672s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Created reservations ['71f883a9-ee01-4131-b626-a63ecbc0260f', '07541365-6665-4ce3-b78c-c22b5ef32a06', 'ad902fab-643d-424f-91aa-4c215e01e73e', 'd78df7b4-5746-4c52-a7af-a0dddddbd8e5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:52 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:52 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.248s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b576404-8fe0-4e4b-8564-ffec788b0e87 tempest-ProjectMemberTests-551412650 None] Lock "cinder-2fe92c55-9f31-4dee-aa24-bf5d26cc38aa-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (6765f6a7-7f75-4891-88d7-765e4ac22946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013763a5-db53-45e7-a40b-4867af032dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013763a5-db53-45e7-a40b-4867af032dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313450612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ff29ae-abd3-47df-9370-cb0e9cf57c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:53Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df37c3a7-4224-4a4c-acf4-a62f45133458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df37c3a7-4224-4a4c-acf4-a62f45133458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b31b09-bd73-4424-a5b8-f5b14d0aa13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b31b09-bd73-4424-a5b8-f5b14d0aa13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ff29ae-abd3-47df-9370-cb0e9cf57c5d', 'volume_name': 'volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b9debf-207c-4edc-8c5f-500d0fb82f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b9debf-207c-4edc-8c5f-500d0fb82f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be72bde-5eca-4a82-bfae-23912b0462f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Volume 89ff29ae-abd3-47df-9370-cb0e9cf57c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d', 'volume_size': 1} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313450612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ff29ae-abd3-47df-9370-cb0e9cf57c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:53Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Creating volume 89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:52 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d 1073741824 Nov 06 21:36:52 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d 1073741824" returned: 0 in 0.409s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:53 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d Nov 06 21:36:53 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" returned: 0 in 0.243s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be72bde-5eca-4a82-bfae-23912b0462f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19a8566-558f-4b21-862e-17f5d2abab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Volume volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d (89ff29ae-abd3-47df-9370-cb0e9cf57c5d): created successfully Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19a8566-558f-4b21-862e-17f5d2abab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (6765f6a7-7f75-4891-88d7-765e4ac22946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:53 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a5c7339c-53a9-4405-b049-9697beebe1a8 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 18e08571-c06b-4d17-baeb-0098c8cd6ca2 of volume 89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[908ad7f4-a424-4c96-a24f-fae10f018db8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d Nov 06 21:36:54 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" returned: 0 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 1G Nov 06 21:36:54 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 1G" returned: 0 in 0.411s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 Nov 06 21:36:54 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2" returned: 0 in 0.286s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 is being set with open permissions: ugo+rw Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 Nov 06 21:36:55 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2" returned: 0 in 0.237s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info Nov 06 21:36:55 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info is being set with open permissions: ugo+rw Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info Nov 06 21:36:55 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.info" returned: 0 in 0.233s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:55 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-5e0afebb-5c59-49a7-ad35-946123f13333 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-18e08571-c06b-4d17-baeb-0098c8cd6ca2-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-18e08571-c06b-4d17-baeb-0098c8cd6ca2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-18e08571-c06b-4d17-baeb-0098c8cd6ca2" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-18e08571-c06b-4d17-baeb-0098c8cd6ca2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 18e08571-c06b-4d17-baeb-0098c8cd6ca2 of volume 89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db96d2a-6d0d-4ae3-a215-6241b451f7c2]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 Nov 06 21:36:56 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2" returned: 0 in 0.352s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad61858-f0f0-4948-81f5-81f0e91bc9ec]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d Nov 06 21:36:56 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 Nov 06 21:36:56 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:57 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2" returned: 0 in 0.326s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:57 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2 Nov 06 21:36:57 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:57 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d.18e08571-c06b-4d17-baeb-0098c8cd6ca2" returned: 0 in 0.239s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-18e08571-c06b-4d17-baeb-0098c8cd6ca2" released by "_delete_snapshot" :: held 1.373s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" released by "delete_snapshot" :: held 1.396s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=156,cinder:SELECT=123,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:UPDATE=156,cinder:SELECT=130,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Created reservations ['3bdf5e24-2003-4231-8dcf-bbc1be2c4ad5', '2241787d-be87-4c61-b619-4e4a38c42395', 'eb583f6a-c182-4ecc-a625-da845ef55931', 'ed7fbf70-9d39-4803-b511-5a6490731385'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:57 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:36:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-a426aefb-24e4-4030-a826-00498652ed11 tempest-ProjectMemberTests-551412650 None] Lock "cinder-18e08571-c06b-4d17-baeb-0098c8cd6ca2-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-89ff29ae-abd3-47df-9370-cb0e9cf57c5d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "cinder-89ff29ae-abd3-47df-9370-cb0e9cf57c5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" acquired by "delete_volume" :: waited 0.013s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd47863-44c4-43e0-a3ae-d85fc7449c91]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d Nov 06 21:36:58 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" returned: 0 in 0.346s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d Nov 06 21:36:58 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-89ff29ae-abd3-47df-9370-cb0e9cf57c5d" released by "delete_volume" :: held 0.652s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Created reservations ['f24d940a-30fa-48ba-82fb-d96292d57048', '48979fca-302c-43d8-b0de-6092ce7bb594', '461e3e4d-e007-4ae3-a7c2-15879406f99a', '04fe245b-52ef-4180-845a-6a495b3de2c4'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:59 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:36:59 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:59 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.242s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-84c5c55d-86db-47ba-add7-266b5983e51b tempest-ProjectMemberTests-551412650 None] Lock "cinder-89ff29ae-abd3-47df-9370-cb0e9cf57c5d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (56517e3d-dfb1-4583-b4e8-6bff88aa1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45fccd5-97be-468c-a047-18d7086f9e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45fccd5-97be-468c-a047-18d7086f9e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518080315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a06617-86bb-4525-9f75-d8826d0503ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:00Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ac3f2b-ad35-4f31-b1b6-c235e634b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ac3f2b-ad35-4f31-b1b6-c235e634b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c110b6e-a7da-45ff-92c3-c1c8b3ee6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c110b6e-a7da-45ff-92c3-c1c8b3ee6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a06617-86bb-4525-9f75-d8826d0503ab', 'volume_name': 'volume-99a06617-86bb-4525-9f75-d8826d0503ab', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f618720e-a3d4-40ae-be42-40183a617389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f618720e-a3d4-40ae-be42-40183a617389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d38298d-4531-419e-92e2-d166555bbafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Volume 99a06617-86bb-4525-9f75-d8826d0503ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a06617-86bb-4525-9f75-d8826d0503ab', 'volume_size': 1} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518080315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a06617-86bb-4525-9f75-d8826d0503ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:00Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Creating volume 99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:59 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:36:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab 1073741824 Nov 06 21:37:00 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:00 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab 1073741824" returned: 0 in 0.425s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab Nov 06 21:37:00 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:00 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab" returned: 0 in 0.250s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d38298d-4531-419e-92e2-d166555bbafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a06617-86bb-4525-9f75-d8826d0503ab', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928a8fe5-b152-4d08-9ea9-80ba5be685b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Volume volume-99a06617-86bb-4525-9f75-d8826d0503ab (99a06617-86bb-4525-9f75-d8826d0503ab): created successfully Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928a8fe5-b152-4d08-9ea9-80ba5be685b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (56517e3d-dfb1-4583-b4e8-6bff88aa1915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:00 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-53cfd1de-9f6d-4f4b-8544-2b097a4cf603 tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 3e9c30aa-97a6-44e8-8e9e-db985b306793 of volume 99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f144c-f540-4549-8aab-6bde6feb9ff3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab Nov 06 21:37:01 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab" returned: 0 in 0.375s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 1G Nov 06 21:37:01 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 1G" returned: 0 in 0.413s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a06617-86bb-4525-9f75-d8826d0503ab -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a06617-86bb-4525-9f75-d8826d0503ab -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 Nov 06 21:37:01 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a06617-86bb-4525-9f75-d8826d0503ab -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793" returned: 0 in 0.295s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 is being set with open permissions: ugo+rw Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 Nov 06 21:37:02 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info Nov 06 21:37:02 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info is being set with open permissions: ugo+rw Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info Nov 06 21:37:02 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.info" returned: 0 in 0.245s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:02 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e27ffff3-08a4-4f83-b499-ba4d2ab10a88 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-3e9c30aa-97a6-44e8-8e9e-db985b306793-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-3e9c30aa-97a6-44e8-8e9e-db985b306793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-3e9c30aa-97a6-44e8-8e9e-db985b306793" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-3e9c30aa-97a6-44e8-8e9e-db985b306793" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 3e9c30aa-97a6-44e8-8e9e-db985b306793 of volume 99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf19ec2-3622-4f91-9ab9-b7b52c07d584]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:03 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 Nov 06 21:37:03 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:03 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793" returned: 0 in 0.378s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a06617-86bb-4525-9f75-d8826d0503ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f61d4d-6b4a-42dd-adb6-b19300237767]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:03 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:03 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab Nov 06 21:37:03 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:04 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab" returned: 0 in 0.385s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 Nov 06 21:37:04 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:04 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793" returned: 0 in 0.342s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793 Nov 06 21:37:04 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:04 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab.3e9c30aa-97a6-44e8-8e9e-db985b306793" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-3e9c30aa-97a6-44e8-8e9e-db985b306793" released by "_delete_snapshot" :: held 1.459s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" released by "delete_snapshot" :: held 1.480s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Created reservations ['5ee49011-1bb6-42c1-8841-5329707dc97b', '133885ae-60bf-49c5-b04a-5a3c67097f73', 'cfe54ad4-33da-4ba0-8c12-f23fdb1df080', 'cd18d527-8963-48df-a4e2-81bfa1e1018a'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:04 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:37:04 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-dc027758-d947-4a2d-8198-40c2c66fa718 tempest-ProjectMemberTests-551412650 None] Lock "cinder-3e9c30aa-97a6-44e8-8e9e-db985b306793-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-99a06617-86bb-4525-9f75-d8826d0503ab-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "cinder-99a06617-86bb-4525-9f75-d8826d0503ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[95224594-1712-4b69-9f66-46c61af8b387]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:05 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab Nov 06 21:37:05 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:05 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab" returned: 0 in 0.400s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:05 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:05 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab Nov 06 21:37:05 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:06 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-99a06617-86bb-4525-9f75-d8826d0503ab" returned: 0 in 0.265s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-99a06617-86bb-4525-9f75-d8826d0503ab" released by "delete_volume" :: held 0.731s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Created reservations ['2b995a60-1adf-4022-9214-62a694980048', '47101e82-81d6-4659-9f9f-a4431c810e74', '05a37a89-ede2-4647-b5c2-ee534c87eb44', '59696ddb-56b4-4f38-87ca-22b28ad8ad4f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:06 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:06 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:06 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:06 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:37:06 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-208e4edb-de76-40fe-ac15-5f1aa832ea0c tempest-ProjectMemberTests-551412650 None] Lock "cinder-99a06617-86bb-4525-9f75-d8826d0503ab-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (c1dae7c1-89f3-4c04-8d2d-bbd3651626f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1bd6d3-6c43-44d9-a23b-4501e2cd2cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1bd6d3-6c43-44d9-a23b-4501e2cd2cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899559037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86daf177-1c1f-4ab0-b86f-111e944180d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:07Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c49dda-0d1b-4270-bd5c-7bbb902de7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c49dda-0d1b-4270-bd5c-7bbb902de7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f831beed-5d74-4011-98ae-7e6290e0f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f831beed-5d74-4011-98ae-7e6290e0f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86daf177-1c1f-4ab0-b86f-111e944180d9', 'volume_name': 'volume-86daf177-1c1f-4ab0-b86f-111e944180d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94af816-4f62-4ab4-8d25-18082c2da9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94af816-4f62-4ab4-8d25-18082c2da9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae2ad18-666f-435a-9ad9-0bad323de75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Volume 86daf177-1c1f-4ab0-b86f-111e944180d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86daf177-1c1f-4ab0-b86f-111e944180d9', 'volume_size': 1} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899559037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86daf177-1c1f-4ab0-b86f-111e944180d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:07Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Creating volume 86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:07 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:07 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 1073741824 Nov 06 21:37:07 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:07 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 1073741824" returned: 0 in 0.418s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:07 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 Nov 06 21:37:07 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:07 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9" returned: 0 in 0.261s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae2ad18-666f-435a-9ad9-0bad323de75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86daf177-1c1f-4ab0-b86f-111e944180d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db37af89-8184-4662-bbc1-b3154e907ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Volume volume-86daf177-1c1f-4ab0-b86f-111e944180d9 (86daf177-1c1f-4ab0-b86f-111e944180d9): created successfully Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db37af89-8184-4662-bbc1-b3154e907ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (c1dae7c1-89f3-4c04-8d2d-bbd3651626f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:07 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-4d650361-4b41-4afe-a4db-f2d4ccd7bb9b tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 67cb44da-3b55-43f2-a141-2fc0c5c38c0a of volume 86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[895554d7-84c4-428d-98e9-ed2a07187f02]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:08 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 Nov 06 21:37:08 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:08 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9" returned: 0 in 0.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:08 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:08 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a 1G Nov 06 21:37:08 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a 1G" returned: 0 in 0.398s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86daf177-1c1f-4ab0-b86f-111e944180d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86daf177-1c1f-4ab0-b86f-111e944180d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a Nov 06 21:37:09 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86daf177-1c1f-4ab0-b86f-111e944180d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a" returned: 0 in 0.297s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a is being set with open permissions: ugo+rw Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a Nov 06 21:37:09 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info Nov 06 21:37:09 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info" returned: 0 in 0.262s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info is being set with open permissions: ugo+rw Nov 06 21:37:09 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info Nov 06 21:37:09 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.info" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:10 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-a8f65972-4eeb-4e78-9601-f25daa3b7f9f tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-67cb44da-3b55-43f2-a141-2fc0c5c38c0a-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-67cb44da-3b55-43f2-a141-2fc0c5c38c0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-67cb44da-3b55-43f2-a141-2fc0c5c38c0a" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-67cb44da-3b55-43f2-a141-2fc0c5c38c0a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 67cb44da-3b55-43f2-a141-2fc0c5c38c0a of volume 86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ddacc0-6155-409d-9bde-527947f31443]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a Nov 06 21:37:10 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a" returned: 0 in 0.356s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86daf177-1c1f-4ab0-b86f-111e944180d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedc478-1805-49ce-9d02-a122c7878852]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:10 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 Nov 06 21:37:10 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9" returned: 0 in 0.362s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a Nov 06 21:37:11 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a" returned: 0 in 0.328s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a Nov 06 21:37:11 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9.67cb44da-3b55-43f2-a141-2fc0c5c38c0a" returned: 0 in 0.245s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-67cb44da-3b55-43f2-a141-2fc0c5c38c0a" released by "_delete_snapshot" :: held 1.391s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" released by "delete_snapshot" :: held 1.413s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Created reservations ['33c4cdf2-1f2c-4d31-9453-7f87e31ada59', '51c04257-8aed-428d-bd8d-178be88b2ccf', '93f988c5-b4ea-427e-9e32-c8e038140f8a', '26dd48f9-e6e3-40f4-86e6-97028cbf25c8'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:11 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:37:11 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-9cff669f-7d40-4f10-8e03-306c2d9c21fa tempest-ProjectMemberTests-551412650 None] Lock "cinder-67cb44da-3b55-43f2-a141-2fc0c5c38c0a-delete_snapshot" released by "delete_snapshot" :: held 1.550s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-86daf177-1c1f-4ab0-b86f-111e944180d9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "cinder-86daf177-1c1f-4ab0-b86f-111e944180d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc475b2-d519-450b-8526-417694df9e5a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:12 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 Nov 06 21:37:12 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9" returned: 0 in 0.373s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9 Nov 06 21:37:13 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-86daf177-1c1f-4ab0-b86f-111e944180d9" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-86daf177-1c1f-4ab0-b86f-111e944180d9" released by "delete_volume" :: held 0.696s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Created reservations ['a7141df9-67b2-4f5a-a853-6cd643edd1ea', '39ed6393-a1bc-41c8-93c2-c1dfa89345f6', '29cc30b2-bc14-4c59-8c00-9d7e88036b2c', '0accb251-5c33-4d0e-9cb8-f693fe57a991'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:13 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:13 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:37:13 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-7f0fe78b-c136-4c6a-8d39-8fb52d44b248 tempest-ProjectMemberTests-551412650 None] Lock "cinder-86daf177-1c1f-4ab0-b86f-111e944180d9-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (16756fd5-253c-4bd2-ac33-104e84f5d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164c83cb-8bba-48cd-852e-6526920ef595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164c83cb-8bba-48cd-852e-6526920ef595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162081851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac0ed01-2fc8-484c-acb6-e0f93b51bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:14Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd97751f-65e0-42f9-9b62-54a0745e3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd97751f-65e0-42f9-9b62-54a0745e3d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c83fba6-3eeb-4c70-982f-1925c827ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c83fba6-3eeb-4c70-982f-1925c827ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac0ed01-2fc8-484c-acb6-e0f93b51bf81', 'volume_name': 'volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ccf32-b2d6-48ec-a670-92367b95d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ccf32-b2d6-48ec-a670-92367b95d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4754f33c-20a4-4b14-9a15-d0ab233eab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:14 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Volume cac0ed01-2fc8-484c-acb6-e0f93b51bf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81', 'volume_size': 1} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162081851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac0ed01-2fc8-484c-acb6-e0f93b51bf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43697fe119c14e318baf8c9f565dea7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:14Z,use_quota=True,user_id='6ad9e1d173d14595be8bf5ff23091dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Creating volume cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:14 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 1073741824 Nov 06 21:37:14 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 1073741824" returned: 0 in 0.420s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 Nov 06 21:37:14 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4754f33c-20a4-4b14-9a15-d0ab233eab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc075d-4568-4dd5-b06b-ecf92e612a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Volume volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 (cac0ed01-2fc8-484c-acb6-e0f93b51bf81): created successfully Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc075d-4568-4dd5-b06b-ecf92e612a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Flow 'volume_create_manager' (16756fd5-253c-4bd2-ac33-104e84f5d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:15 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-423f4270-d637-419c-b2b0-e9d977c7957a tempest-ProjectMemberTests-551412650 None] Created volume successfully. Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Creating offline snapshot 74abcc07-9771-4f4b-80cf-da403e77a52c of volume cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b90388-731a-4fc0-af45-a296bfe78c35]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 Nov 06 21:37:15 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" returned: 0 in 0.359s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c 1G Nov 06 21:37:15 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c 1G" returned: 0 in 0.398s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c Nov 06 21:37:16 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c" returned: 0 in 0.290s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c is being set with open permissions: ugo+rw Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c Nov 06 21:37:16 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info Nov 06 21:37:16 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info" returned: 0 in 0.274s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info is being set with open permissions: ugo+rw Nov 06 21:37:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info Nov 06 21:37:17 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:17 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.info" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:17 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0039c0cc-d49b-44f6-bb6a-b2397a7a8735 tempest-ProjectMemberTests-551412650 None] Create snapshot completed successfully Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-74abcc07-9771-4f4b-80cf-da403e77a52c-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-74abcc07-9771-4f4b-80cf-da403e77a52c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-74abcc07-9771-4f4b-80cf-da403e77a52c" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-74abcc07-9771-4f4b-80cf-da403e77a52c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Deleting offline snapshot 74abcc07-9771-4f4b-80cf-da403e77a52c of volume cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] snapshot_file for this snap is: volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5811588a-f663-4681-941b-b6c4a33f603c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c Nov 06 21:37:17 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:18 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c" returned: 0 in 0.386s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea65fb-c63b-4d26-94b4-e91022bc6b2a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:18 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 Nov 06 21:37:18 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:18 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:18 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c Nov 06 21:37:18 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:18 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c" returned: 0 in 0.336s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:18 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c Nov 06 21:37:18 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:19 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81.74abcc07-9771-4f4b-80cf-da403e77a52c" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-74abcc07-9771-4f4b-80cf-da403e77a52c" released by "_delete_snapshot" :: held 1.417s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" released by "delete_snapshot" :: held 1.438s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Created reservations ['4bb3198c-9972-4afa-8d65-6406b7d53714', '084518b7-c00e-4281-9c97-585e162836a8', '7bf22df6-d767-4656-999c-da243e4d8254', 'aed71a46-5fac-4e58-b1d7-df853356028e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Delete snapshot completed successfully. Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d248cc1a-7596-43de-ad89-2f2215ef36dd tempest-ProjectMemberTests-551412650 None] Lock "cinder-74abcc07-9771-4f4b-80cf-da403e77a52c-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-cac0ed01-2fc8-484c-acb6-e0f93b51bf81-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "cinder-cac0ed01-2fc8-484c-acb6-e0f93b51bf81-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Acquiring lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" acquired by "delete_volume" :: waited 0.032s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe01fc-cd43-4e64-997e-8e8782bb0e1a]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 Nov 06 21:37:20 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" returned: 0 in 0.374s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81 Nov 06 21:37:20 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" returned: 0 in 0.277s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "cinder-quobyte-cac0ed01-2fc8-484c-acb6-e0f93b51bf81" released by "delete_volume" :: held 0.722s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Created reservations ['db5dcf41-e3af-4ef2-96e7-03166f29a4a4', '2519820f-bce9-4a49-86f8-ed293597bb06', '3cde34a4-b7ff-473d-8934-a5d0e5cc1615', '7f80238e-06c4-4ee3-b667-4c86d53827b2'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:20 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:21 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:21 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Deleted volume successfully. Nov 06 21:37:21 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-d31e3d41-e8d3-412d-ae21-46ef364017d1 tempest-ProjectMemberTests-551412650 None] Lock "cinder-cac0ed01-2fc8-484c-acb6-e0f93b51bf81-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (c4b59aca-8228-4518-9bc5-48ac176dceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a177e3-bb56-4995-8412-452aa86912fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a177e3-bb56-4995-8412-452aa86912fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105713618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23f321d-1af1-4852-be23-74caac93703d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:25Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b3d910-c4bf-4197-9bac-d8ee2925ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b3d910-c4bf-4197-9bac-d8ee2925ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892335b-b6e3-4e53-b07c-e3d902340fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892335b-b6e3-4e53-b07c-e3d902340fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23f321d-1af1-4852-be23-74caac93703d', 'volume_name': 'volume-f23f321d-1af1-4852-be23-74caac93703d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a365ea2f-6a79-475c-ab20-7a25973807dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a365ea2f-6a79-475c-ab20-7a25973807dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d407e916-06de-4e19-a885-db78f0d797bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Volume f23f321d-1af1-4852-be23-74caac93703d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23f321d-1af1-4852-be23-74caac93703d', 'volume_size': 1} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105713618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23f321d-1af1-4852-be23-74caac93703d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:25Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Creating volume f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d 1073741824 Nov 06 21:37:24 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d 1073741824" returned: 0 in 0.424s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d Nov 06 21:37:25 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d" returned: 0 in 0.236s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d407e916-06de-4e19-a885-db78f0d797bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23f321d-1af1-4852-be23-74caac93703d', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f34aa33-b7f9-4bc8-a7a6-c235b82b51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:25 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Volume volume-f23f321d-1af1-4852-be23-74caac93703d (f23f321d-1af1-4852-be23-74caac93703d): created successfully Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f34aa33-b7f9-4bc8-a7a6-c235b82b51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (c4b59aca-8228-4518-9bc5-48ac176dceed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:25 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-53f26008-28c4-4096-a4cc-a7a90ee39380 tempest-ProjectReaderTests-1512165976 None] Created volume successfully. Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Creating offline snapshot fdac10b6-488d-413a-a207-556e486a88d3 of volume f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2cdf7d-d5a5-425b-8e4d-3df24c5423ae]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d Nov 06 21:37:25 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d" returned: 0 in 0.341s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 1G Nov 06 21:37:26 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 1G" returned: 0 in 0.387s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f23f321d-1af1-4852-be23-74caac93703d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f23f321d-1af1-4852-be23-74caac93703d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 Nov 06 21:37:26 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f23f321d-1af1-4852-be23-74caac93703d -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3" returned: 0 in 0.290s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 is being set with open permissions: ugo+rw Nov 06 21:37:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 Nov 06 21:37:26 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3" returned: 0 in 0.234s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info Nov 06 21:37:27 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info" returned: 0 in 0.240s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info is being set with open permissions: ugo+rw Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info Nov 06 21:37:27 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.info" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-30a85440-0de0-4044-ad6d-420b19ef658e tempest-ProjectReaderTests-1512165976 None] Create snapshot completed successfully Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-fdac10b6-488d-413a-a207-556e486a88d3-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-fdac10b6-488d-413a-a207-556e486a88d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-fdac10b6-488d-413a-a207-556e486a88d3" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-fdac10b6-488d-413a-a207-556e486a88d3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Deleting offline snapshot fdac10b6-488d-413a-a207-556e486a88d3 of volume f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] snapshot_file for this snap is: volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93c6fe-818d-4f78-98e0-a5c68f5d4852]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 Nov 06 21:37:28 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3" returned: 0 in 0.383s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f23f321d-1af1-4852-be23-74caac93703d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b302bcd-a484-4ac2-95b6-03808c0facb4]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d Nov 06 21:37:28 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d" returned: 0 in 0.364s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:28 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 Nov 06 21:37:28 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3" returned: 0 in 0.325s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3 Nov 06 21:37:29 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d.fdac10b6-488d-413a-a207-556e486a88d3" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-fdac10b6-488d-413a-a207-556e486a88d3" released by "_delete_snapshot" :: held 1.421s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" released by "delete_snapshot" :: held 1.441s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Created reservations ['456523ef-2f40-497a-806c-3cfc92df015b', 'd57d9436-662b-42a7-9905-63b27f7df605', '8bd9a4ec-c715-44a5-8f78-c742fe5d6470', 'cd271057-05d2-443b-b982-126e5bb4e84f'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:29 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Delete snapshot completed successfully. Nov 06 21:37:29 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-00c4267f-f3e1-43b4-a740-46de9fe8b48b tempest-ProjectReaderTests-1512165976 None] Lock "cinder-fdac10b6-488d-413a-a207-556e486a88d3-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-f23f321d-1af1-4852-be23-74caac93703d-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-f23f321d-1af1-4852-be23-74caac93703d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919bcd0-4fa9-40e7-8cc5-6663ba3fd520]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d Nov 06 21:37:30 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d" returned: 0 in 0.351s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d Nov 06 21:37:30 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f23f321d-1af1-4852-be23-74caac93703d" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f23f321d-1af1-4852-be23-74caac93703d" released by "delete_volume" :: held 0.671s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Created reservations ['3fe2314c-c1c3-4733-b302-1af2d90ea619', '5f9eb16b-6118-4e51-9ecb-f864505d0007', '1ecd8d59-842d-4109-af64-a32bc237e6a0', '842350ce-1695-4cf5-8e4b-4e3041fa7b65'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:31 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.269s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:31 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Deleted volume successfully. Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-8b00986b-ba2e-4c52-91ad-711073e8d139 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-f23f321d-1af1-4852-be23-74caac93703d-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (a78b4ec9-17b9-44e5-bb07-cfdeed24661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8169bc5-fc53-4ad4-ae1a-7eef5b4e9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8169bc5-fc53-4ad4-ae1a-7eef5b4e9c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712855378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828944e3-f916-4410-9d44-5bb41095a6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:32Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0da7555-77ab-43ee-bfc9-aab0b21fd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0da7555-77ab-43ee-bfc9-aab0b21fd62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f782831-f0de-4d85-b1a0-d3c326bbf53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f782831-f0de-4d85-b1a0-d3c326bbf53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828944e3-f916-4410-9d44-5bb41095a6af', 'volume_name': 'volume-828944e3-f916-4410-9d44-5bb41095a6af', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d0c66-58cf-4d1a-ac27-a7e848bd2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d0c66-58cf-4d1a-ac27-a7e848bd2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3bec47-ca82-41de-8004-b3f61c455f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Volume 828944e3-f916-4410-9d44-5bb41095a6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828944e3-f916-4410-9d44-5bb41095a6af', 'volume_size': 1} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712855378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828944e3-f916-4410-9d44-5bb41095a6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:32Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Creating volume 828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:31 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:31 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af 1073741824 Nov 06 21:37:31 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af 1073741824" returned: 0 in 0.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af Nov 06 21:37:32 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af" returned: 0 in 0.249s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3bec47-ca82-41de-8004-b3f61c455f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828944e3-f916-4410-9d44-5bb41095a6af', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd49fd-3b65-4429-85a0-2b6ac8c46786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:32 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Volume volume-828944e3-f916-4410-9d44-5bb41095a6af (828944e3-f916-4410-9d44-5bb41095a6af): created successfully Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd49fd-3b65-4429-85a0-2b6ac8c46786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:32 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (a78b4ec9-17b9-44e5-bb07-cfdeed24661a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:32 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-dc3256f8-5c7a-4f63-bad9-53314f958c90 tempest-ProjectReaderTests-1512165976 None] Created volume successfully. Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Creating offline snapshot 0b758a49-d7a7-4b69-ae78-c0710518d85b of volume 828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9e64c-bc4c-46d8-88c5-3976de68d33c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af Nov 06 21:37:33 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af" returned: 0 in 0.349s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b 1G Nov 06 21:37:33 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b 1G" returned: 0 in 0.405s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828944e3-f916-4410-9d44-5bb41095a6af -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828944e3-f916-4410-9d44-5bb41095a6af -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b Nov 06 21:37:33 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828944e3-f916-4410-9d44-5bb41095a6af -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b" returned: 0 in 0.296s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b is being set with open permissions: ugo+rw Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b Nov 06 21:37:34 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b" returned: 0 in 0.245s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info Nov 06 21:37:34 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info" returned: 0 in 0.252s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info is being set with open permissions: ugo+rw Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info Nov 06 21:37:34 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.info" returned: 0 in 0.242s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:34 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-87be50fb-becd-4b1c-813e-7ff59426947e tempest-ProjectReaderTests-1512165976 None] Create snapshot completed successfully Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-0b758a49-d7a7-4b69-ae78-c0710518d85b-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-0b758a49-d7a7-4b69-ae78-c0710518d85b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-0b758a49-d7a7-4b69-ae78-c0710518d85b" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-0b758a49-d7a7-4b69-ae78-c0710518d85b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Deleting offline snapshot 0b758a49-d7a7-4b69-ae78-c0710518d85b of volume 828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] snapshot_file for this snap is: volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06e209-98ee-44b3-af4e-c6efd4851d38]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:35 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b Nov 06 21:37:35 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:35 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b" returned: 0 in 0.361s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828944e3-f916-4410-9d44-5bb41095a6af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be12124-a0c4-4f13-a06e-0190f6dacda1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:35 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af Nov 06 21:37:35 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:35 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af" returned: 0 in 0.357s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b Nov 06 21:37:36 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b" returned: 0 in 0.329s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b Nov 06 21:37:36 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af.0b758a49-d7a7-4b69-ae78-c0710518d85b" returned: 0 in 0.242s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-0b758a49-d7a7-4b69-ae78-c0710518d85b" released by "_delete_snapshot" :: held 1.386s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" released by "delete_snapshot" :: held 1.408s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Created reservations ['790a803d-78b8-4dcb-9afe-1d947b7efd72', 'f6400b91-6cd5-4489-a5a1-a603be789a48', '5cae228d-27af-432e-b5e6-25809d0fcb16', 'd189db1b-da7e-4714-92fd-fb7995d371f0'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:36 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Delete snapshot completed successfully. Nov 06 21:37:36 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-91b7a189-e973-4a37-a2ad-be11438d8dc1 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-0b758a49-d7a7-4b69-ae78-c0710518d85b-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-828944e3-f916-4410-9d44-5bb41095a6af-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-828944e3-f916-4410-9d44-5bb41095a6af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e25ec3-c0b0-45d0-a1d4-320528ea8e16]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af Nov 06 21:37:37 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af" returned: 0 in 0.355s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af Nov 06 21:37:37 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-828944e3-f916-4410-9d44-5bb41095a6af" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-828944e3-f916-4410-9d44-5bb41095a6af" released by "delete_volume" :: held 0.667s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Created reservations ['b74a0913-547a-4cc0-befe-0faf5016fce8', '19009677-4251-45ef-9da9-77ed8f58cccd', '7242f97c-7cb3-4f1a-9490-aa3ce6a1a962', '6bf194f5-1a07-440a-9335-d5866984b347'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:38 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:38 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.259s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:38 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Deleted volume successfully. Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50f62808-458a-4f50-947a-69ae877383d9 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-828944e3-f916-4410-9d44-5bb41095a6af-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:38 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (6a28d23e-0d6d-47d9-9a5a-ba9b922a914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1983f-dfeb-49c6-a992-45eadfa195c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1983f-dfeb-49c6-a992-45eadfa195c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19579967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420bda38-123c-4170-ba8b-d5df7cce2864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:39Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70be54b6-eb7a-4a95-afd4-f184dffe0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70be54b6-eb7a-4a95-afd4-f184dffe0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9076d6ff-a805-4711-b76c-5a851536ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9076d6ff-a805-4711-b76c-5a851536ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420bda38-123c-4170-ba8b-d5df7cce2864', 'volume_name': 'volume-420bda38-123c-4170-ba8b-d5df7cce2864', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b889dc7-f8c4-42d0-bdab-58a66c495d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b889dc7-f8c4-42d0-bdab-58a66c495d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4766540-d269-43ed-8e7b-e4b7523c7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Volume 420bda38-123c-4170-ba8b-d5df7cce2864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420bda38-123c-4170-ba8b-d5df7cce2864', 'volume_size': 1} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19579967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420bda38-123c-4170-ba8b-d5df7cce2864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:39Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Creating volume 420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:39 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 1073741824 Nov 06 21:37:39 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 1073741824" returned: 0 in 0.400s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 Nov 06 21:37:39 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864" returned: 0 in 0.240s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4766540-d269-43ed-8e7b-e4b7523c7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420bda38-123c-4170-ba8b-d5df7cce2864', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc327670-a54f-4633-8521-f4862d4c8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:39 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Volume volume-420bda38-123c-4170-ba8b-d5df7cce2864 (420bda38-123c-4170-ba8b-d5df7cce2864): created successfully Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc327670-a54f-4633-8521-f4862d4c8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (6a28d23e-0d6d-47d9-9a5a-ba9b922a914b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:39 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0c5a684e-4a42-401b-813d-5923dc847ce6 tempest-ProjectReaderTests-1512165976 None] Created volume successfully. Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Creating offline snapshot d1a69d3d-0298-4847-938a-38c1319b512e of volume 420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0187dee-beae-4857-9f74-bef2591768c9]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 Nov 06 21:37:40 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864" returned: 0 in 0.362s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e 1G Nov 06 21:37:40 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e 1G" returned: 0 in 0.394s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420bda38-123c-4170-ba8b-d5df7cce2864 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420bda38-123c-4170-ba8b-d5df7cce2864 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e Nov 06 21:37:40 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420bda38-123c-4170-ba8b-d5df7cce2864 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e" returned: 0 in 0.285s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e is being set with open permissions: ugo+rw Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e Nov 06 21:37:41 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e" returned: 0 in 0.246s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info Nov 06 21:37:41 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info" returned: 0 in 0.260s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info is being set with open permissions: ugo+rw Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info Nov 06 21:37:41 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.info" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:42 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-8207200a-0c1a-4e8b-b3de-3e7bd2e57a35 tempest-ProjectReaderTests-1512165976 None] Create snapshot completed successfully Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-d1a69d3d-0298-4847-938a-38c1319b512e-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-d1a69d3d-0298-4847-938a-38c1319b512e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-d1a69d3d-0298-4847-938a-38c1319b512e" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-d1a69d3d-0298-4847-938a-38c1319b512e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Deleting offline snapshot d1a69d3d-0298-4847-938a-38c1319b512e of volume 420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] snapshot_file for this snap is: volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbbd9c0-0ee0-48b0-9f7f-5e2700f2d884]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e Nov 06 21:37:42 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:42 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e" returned: 0 in 0.399s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420bda38-123c-4170-ba8b-d5df7cce2864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d625fd-b206-4914-80a0-93275cf5e75e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:42 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 Nov 06 21:37:42 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864" returned: 0 in 0.393s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e Nov 06 21:37:43 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e Nov 06 21:37:43 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864.d1a69d3d-0298-4847-938a-38c1319b512e" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-d1a69d3d-0298-4847-938a-38c1319b512e" released by "_delete_snapshot" :: held 1.540s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" released by "delete_snapshot" :: held 1.565s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Created reservations ['9cfb2473-a1b0-445e-89d2-807fe3b63ba6', '692f9ed3-86f5-46ed-a212-27db55fedfea', '4e9ddd84-628b-468b-858c-90fa5500ab54', 'efbf588d-c5f8-40bd-bf83-5e0e9046c2d5'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:43 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Delete snapshot completed successfully. Nov 06 21:37:43 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-290cfd41-cdfb-412a-81bd-d0c979dfa170 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-d1a69d3d-0298-4847-938a-38c1319b512e-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-420bda38-123c-4170-ba8b-d5df7cce2864-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-420bda38-123c-4170-ba8b-d5df7cce2864-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f35988-a205-4934-95ae-baa7b026ae4d]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 Nov 06 21:37:44 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:44 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864" returned: 0 in 0.362s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:44 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864 Nov 06 21:37:44 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-420bda38-123c-4170-ba8b-d5df7cce2864" returned: 0 in 0.239s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-420bda38-123c-4170-ba8b-d5df7cce2864" released by "delete_volume" :: held 0.665s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Created reservations ['1fa0f1e8-432d-4dfc-9e63-869ec1999df2', '87f37e99-1da9-4276-84af-177197ff4f19', 'eb429614-3c46-4f6f-943d-e6a3d5854f3e', 'f014b670-b85e-4a09-8d2b-ade6c231717d'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:45 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:45 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.259s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:45 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Deleted volume successfully. Nov 06 21:37:45 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-538dab85-7be5-49c5-8295-8cd0dd74b4a4 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-420bda38-123c-4170-ba8b-d5df7cce2864-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (5c63d108-4d34-46cd-b3ba-f8219376c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc87ae-f6cb-48a1-bd3c-50ad149bd927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc87ae-f6cb-48a1-bd3c-50ad149bd927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532283083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b056bf0a-6817-4f49-bb90-ffafb217ab56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:46Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71383d52-023f-42cb-83eb-14f3c9e39357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71383d52-023f-42cb-83eb-14f3c9e39357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7027e6-7bb7-4ffa-8d16-10b2c70cbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7027e6-7bb7-4ffa-8d16-10b2c70cbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b056bf0a-6817-4f49-bb90-ffafb217ab56', 'volume_name': 'volume-b056bf0a-6817-4f49-bb90-ffafb217ab56', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c3c599-9eed-4a70-8f5a-473fb98f174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c3c599-9eed-4a70-8f5a-473fb98f174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ac7b4f-1c65-4acc-b094-bd7956aeba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Volume b056bf0a-6817-4f49-bb90-ffafb217ab56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b056bf0a-6817-4f49-bb90-ffafb217ab56', 'volume_size': 1} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532283083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b056bf0a-6817-4f49-bb90-ffafb217ab56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:46Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Creating volume b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:46 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 1073741824 Nov 06 21:37:46 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 1073741824" returned: 0 in 0.426s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 Nov 06 21:37:46 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56" returned: 0 in 0.254s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ac7b4f-1c65-4acc-b094-bd7956aeba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b056bf0a-6817-4f49-bb90-ffafb217ab56', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf72dde-eb31-418a-9a08-7cfb58ead86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:46 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Volume volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 (b056bf0a-6817-4f49-bb90-ffafb217ab56): created successfully Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf72dde-eb31-418a-9a08-7cfb58ead86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:46 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (5c63d108-4d34-46cd-b3ba-f8219376c19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:46 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f178f0e0-3796-43d7-ad2f-45377333bdfc tempest-ProjectReaderTests-1512165976 None] Created volume successfully. Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Creating offline snapshot 4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 of volume b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9942cc5e-e8dd-4e08-ae06-e6b79b4dc5b1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 Nov 06 21:37:47 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:47 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56" returned: 0 in 0.364s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:47 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 1G Nov 06 21:37:47 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 1G" returned: 0 in 0.395s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 Nov 06 21:37:48 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" returned: 0 in 0.282s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 is being set with open permissions: ugo+rw Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 Nov 06 21:37:48 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info Nov 06 21:37:48 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info" returned: 0 in 0.263s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info is being set with open permissions: ugo+rw Nov 06 21:37:48 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info Nov 06 21:37:48 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:49 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.info" returned: 0 in 0.266s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:49 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f2ce8537-8091-417a-871a-b327e91125ec tempest-ProjectReaderTests-1512165976 None] Create snapshot completed successfully Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Deleting offline snapshot 4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 of volume b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] snapshot_file for this snap is: volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[43403b46-07d6-4b90-a4f2-18678b21791e]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:49 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 Nov 06 21:37:49 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:49 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" returned: 0 in 0.358s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b056bf0a-6817-4f49-bb90-ffafb217ab56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3af76c9-d18d-4053-8265-2ca9b00d8565]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:49 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:49 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 Nov 06 21:37:49 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56" returned: 0 in 0.359s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:50 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 Nov 06 21:37:50 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" returned: 0 in 0.348s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:50 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2 Nov 06 21:37:50 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56.4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" returned: 0 in 0.247s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2" released by "_delete_snapshot" :: held 1.424s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" released by "delete_snapshot" :: held 1.446s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Created reservations ['c213ad69-31f8-4d1d-899d-369a47779d84', 'b4a60212-46da-4f4f-8699-1caf534ff10d', '3c53d775-b09c-45ac-9db2-5f9885cad87d', 'b8e2752a-d115-476d-bbf1-93ff2c25a93c'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:50 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Delete snapshot completed successfully. Nov 06 21:37:50 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-50b3e014-b4de-431b-aeb3-6748b762d080 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-4e637ba2-f698-4091-bf33-e3fcc6c5fbe2-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-b056bf0a-6817-4f49-bb90-ffafb217ab56-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-b056bf0a-6817-4f49-bb90-ffafb217ab56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ddaa03-7fda-4ac2-91b9-965545711e06]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:51 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 Nov 06 21:37:51 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56" returned: 0 in 0.367s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56 Nov 06 21:37:52 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-b056bf0a-6817-4f49-bb90-ffafb217ab56" returned: 0 in 0.243s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-b056bf0a-6817-4f49-bb90-ffafb217ab56" released by "delete_volume" :: held 0.674s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Created reservations ['141651af-ce23-4be4-bac5-f86fcdbbb322', 'ade252c2-6f34-4558-9155-2fb495d25fb2', '06382fb3-5de1-4eb7-9b8f-27e4647051c5', '4c2fd03e-8dd6-4868-9cdc-6a05b778b951'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:52 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.276s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:52 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Deleted volume successfully. Nov 06 21:37:52 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e1755ca3-f19d-4820-b6ab-dc84d95cb1c8 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-b056bf0a-6817-4f49-bb90-ffafb217ab56-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (3f393c04-f459-4204-9d3d-0139d7aa443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5990b8-ee87-465c-b8e1-9a5b2ed948ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5990b8-ee87-465c-b8e1-9a5b2ed948ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367431937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f951eb39-0dae-45ba-a4a1-b00e97ebe4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:53Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2d256d-c04a-4818-8a75-4149a28a5f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2d256d-c04a-4818-8a75-4149a28a5f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69556bb-6155-47de-b55a-3fe7e8857f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69556bb-6155-47de-b55a-3fe7e8857f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f951eb39-0dae-45ba-a4a1-b00e97ebe4d9', 'volume_name': 'volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6faa7c-45e4-4c24-b6c2-50b31fe5a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6faa7c-45e4-4c24-b6c2-50b31fe5a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f19332-4727-46f2-9cbd-2ff28df98954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Volume f951eb39-0dae-45ba-a4a1-b00e97ebe4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9', 'volume_size': 1} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367431937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f951eb39-0dae-45ba-a4a1-b00e97ebe4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b566b832bbff42009476ae9f07e2a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:53Z,use_quota=True,user_id='410c3dba40aa4881affb7b19e43a6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Creating volume f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:53 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:53 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 1073741824 Nov 06 21:37:53 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:53 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 1073741824" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:53 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 Nov 06 21:37:53 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:53 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f19332-4727-46f2-9cbd-2ff28df98954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac6563-282d-4eba-a583-5bf1d1bbc01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:53 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Volume volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 (f951eb39-0dae-45ba-a4a1-b00e97ebe4d9): created successfully Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ac6563-282d-4eba-a583-5bf1d1bbc01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:53 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Flow 'volume_create_manager' (3f393c04-f459-4204-9d3d-0139d7aa443e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:54 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-47100f3b-a1f4-428e-a4b7-86ef620c1990 tempest-ProjectReaderTests-1512165976 None] Created volume successfully. Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Creating offline snapshot 855511eb-d914-4f0f-8c78-bd21792b37f9 of volume f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef02d40-2613-4ee7-b1c0-40df67b1edaa]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 Nov 06 21:37:54 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" returned: 0 in 0.360s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 1G {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 1G Nov 06 21:37:54 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 1G" returned: 0 in 0.395s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 Nov 06 21:37:55 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 -F qcow2 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9" returned: 0 in 0.298s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 is being set with open permissions: ugo+rw Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 Nov 06 21:37:55 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9" returned: 0 in 0.253s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info Nov 06 21:37:55 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info" returned: 0 in 0.271s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87230]: WARNING cinder.volume.drivers.remotefs [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info is being set with open permissions: ugo+rw Nov 06 21:37:55 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info Nov 06 21:37:55 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.info" returned: 0 in 0.238s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:56 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-075749e3-2035-4b1a-a1f0-8254d75c3638 tempest-ProjectReaderTests-1512165976 None] Create snapshot completed successfully Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-855511eb-d914-4f0f-8c78-bd21792b37f9-delete_snapshot" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-855511eb-d914-4f0f-8c78-bd21792b37f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" by "delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-855511eb-d914-4f0f-8c78-bd21792b37f9" by "_delete_snapshot" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-855511eb-d914-4f0f-8c78-bd21792b37f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Deleting offline snapshot 855511eb-d914-4f0f-8c78-bd21792b37f9 of volume f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] snapshot_file for this snap is: volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dccc36-e210-4119-82a4-cfd23d3e809b]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 Nov 06 21:37:56 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9" returned: 0 in 0.369s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87230) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[85550a4f-ce07-47ec-a437-db1c9b9c22b1]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:56 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:57 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 Nov 06 21:37:57 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:57 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" returned: 0 in 0.350s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:57 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 Nov 06 21:37:57 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:57 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9" returned: 0 in 0.340s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:57 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9 Nov 06 21:37:57 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:57 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9.855511eb-d914-4f0f-8c78-bd21792b37f9" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-855511eb-d914-4f0f-8c78-bd21792b37f9" released by "_delete_snapshot" :: held 1.411s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" released by "delete_snapshot" :: held 1.433s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=110,cinder:INSERT=45,cinder:UPDATE=144,cinder:DELETE=15 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=115,cinder:INSERT=35,cinder:UPDATE=145,cinder:DELETE=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:57 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Created reservations ['f0186dca-f529-4259-a3e0-5e18dff1eec7', 'dc51d3e9-672f-4962-bd8f-8cbb56daadd9', '9ea0bc22-9af8-4d67-a7a1-e4f09fd9e75a', 'f09f8294-4784-4fce-967a-91f266c3a38e'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:58 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Delete snapshot completed successfully. Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-2e9d540e-8a34-42bb-90a9-f2b1c90c5b1d tempest-ProjectReaderTests-1512165976 None] Lock "cinder-855511eb-d914-4f0f-8c78-bd21792b37f9-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8d6ea-c2db-4ec6-b5df-a7f37ae941da]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:58 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:58 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 Nov 06 21:37:58 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:59 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" returned: 0 in 0.376s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:59 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9 Nov 06 21:37:59 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:59 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-quobyte-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9" released by "delete_volume" :: held 0.689s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Created reservations ['0a26f9bc-c8f2-4337-84f3-f3f0e0e750ac', 'c333e3d5-1f92-4315-b19b-58ed0fe2b619', '4bb3549d-c508-4bce-8d54-b67278ab55c7', '3714f6c5-1b46-4bfa-9733-345adb2d1236'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:59 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:37:59 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:59 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.279s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:59 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Deleted volume successfully. Nov 06 21:37:59 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-e91e2a97-f829-41a2-91bd-1a787c0299b6 tempest-ProjectReaderTests-1512165976 None] Lock "cinder-f951eb39-0dae-45ba-a4a1-b00e97ebe4d9-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:09 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:09 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:INSERT=5,cinder:UPDATE=15,cinder:SELECT=4,cinder:DELETE=1 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (19fbf6ec-6981-4f74-b208-b7c8d0f47499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd6d62-5efd-4018-a13a-2596969234bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebd6d62-5efd-4018-a13a-2596969234bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931094904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c427245e-1a6e-464e-973b-7b951f4b7009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:16Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5a05c5-1359-4e72-affb-07d50a2fede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5a05c5-1359-4e72-affb-07d50a2fede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cf700d-8b3c-472c-98e1-1426e17345c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cf700d-8b3c-472c-98e1-1426e17345c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c427245e-1a6e-464e-973b-7b951f4b7009', 'volume_name': 'volume-c427245e-1a6e-464e-973b-7b951f4b7009', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61f274e-d70d-4477-8c40-b79df71db527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61f274e-d70d-4477-8c40-b79df71db527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd6cbed-7c2c-4847-9f52-0dcad9b9dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Volume c427245e-1a6e-464e-973b-7b951f4b7009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c427245e-1a6e-464e-973b-7b951f4b7009', 'volume_size': 1} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931094904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c427245e-1a6e-464e-973b-7b951f4b7009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:16Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Creating volume c427245e-1a6e-464e-973b-7b951f4b7009 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:15 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:38:15 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:15 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 1073741824 Nov 06 21:38:15 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:16 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 1073741824" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:16 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 Nov 06 21:38:16 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:16 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009" returned: 0 in 0.258s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd6cbed-7c2c-4847-9f52-0dcad9b9dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c427245e-1a6e-464e-973b-7b951f4b7009', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d7e8f-5d69-4fd6-9d6a-4f0c509dc72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:16 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Volume volume-c427245e-1a6e-464e-973b-7b951f4b7009 (c427245e-1a6e-464e-973b-7b951f4b7009): created successfully Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d7e8f-5d69-4fd6-9d6a-4f0c509dc72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:16 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (19fbf6ec-6981-4f74-b208-b7c8d0f47499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:16 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-2ce71508-6e4d-4c77-a711-18d7b35b0c50 tempest-ProjectReaderTests-1471367775 None] Created volume successfully. Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-c427245e-1a6e-464e-973b-7b951f4b7009-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-c427245e-1a6e-464e-973b-7b951f4b7009-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-quobyte-c427245e-1a6e-464e-973b-7b951f4b7009" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-c427245e-1a6e-464e-973b-7b951f4b7009" acquired by "delete_volume" :: waited 0.016s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3fa1a-d88e-4e8e-bebb-3398f4f999b8]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 Nov 06 21:38:17 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:17 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009" returned: 0 in 0.353s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009 Nov 06 21:38:17 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:17 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-c427245e-1a6e-464e-973b-7b951f4b7009" returned: 0 in 0.251s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-c427245e-1a6e-464e-973b-7b951f4b7009" released by "delete_volume" :: held 0.646s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Created reservations ['eba1d276-eee0-402d-a4bd-b703f14b1392', 'ec8fb30c-57d4-4905-a028-2de9c4978896', 'bfd60426-69f1-4e27-8c6d-7d8447372e37', '703df7f7-9494-40d9-9ecb-174a9f7dd556'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:17 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:17 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:38:17 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:18 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.244s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:18 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Deleted volume successfully. Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-53feeac6-bbd3-484a-a6d6-9135017e5b27 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-c427245e-1a6e-464e-973b-7b951f4b7009-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (61b9ab33-7b7e-44eb-ac75-e8dd680d6dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c5ea9e-9581-47f9-9bdf-85dbddf0f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c5ea9e-9581-47f9-9bdf-85dbddf0f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058151125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1351ae-7541-471e-9c2f-17999173dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:19Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c99601c-c71f-4c08-87da-4574db3ebb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c99601c-c71f-4c08-87da-4574db3ebb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e17e7eb-3f8a-4783-b850-4a5226109b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e17e7eb-3f8a-4783-b850-4a5226109b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1351ae-7541-471e-9c2f-17999173dd32', 'volume_name': 'volume-0d1351ae-7541-471e-9c2f-17999173dd32', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173d699-f65f-4abd-af56-0feb16a38e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173d699-f65f-4abd-af56-0feb16a38e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5064125b-db09-4b37-8e22-325c2daf2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:18 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Volume 0d1351ae-7541-471e-9c2f-17999173dd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1351ae-7541-471e-9c2f-17999173dd32', 'volume_size': 1} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058151125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1351ae-7541-471e-9c2f-17999173dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:19Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Creating volume 0d1351ae-7541-471e-9c2f-17999173dd32 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:18 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:38:18 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:18 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 1073741824 Nov 06 21:38:18 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:19 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 1073741824" returned: 0 in 0.417s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:19 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 Nov 06 21:38:19 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:19 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32" returned: 0 in 0.242s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5064125b-db09-4b37-8e22-325c2daf2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1351ae-7541-471e-9c2f-17999173dd32', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32ef18d-4c71-4070-b960-0b21af546344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:19 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Volume volume-0d1351ae-7541-471e-9c2f-17999173dd32 (0d1351ae-7541-471e-9c2f-17999173dd32): created successfully Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32ef18d-4c71-4070-b960-0b21af546344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (61b9ab33-7b7e-44eb-ac75-e8dd680d6dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:19 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-cd975fff-a2c4-4796-95c7-bfafcddd3055 tempest-ProjectReaderTests-1471367775 None] Created volume successfully. Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-0d1351ae-7541-471e-9c2f-17999173dd32-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-0d1351ae-7541-471e-9c2f-17999173dd32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-quobyte-0d1351ae-7541-471e-9c2f-17999173dd32" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-0d1351ae-7541-471e-9c2f-17999173dd32" acquired by "delete_volume" :: waited 0.014s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[065b0bd9-71d3-49d0-8850-00302baf57c3]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:19 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:19 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 Nov 06 21:38:19 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:20 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32" returned: 0 in 0.375s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:20 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32 Nov 06 21:38:20 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:20 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-0d1351ae-7541-471e-9c2f-17999173dd32" returned: 0 in 0.244s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-0d1351ae-7541-471e-9c2f-17999173dd32" released by "delete_volume" :: held 0.657s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Created reservations ['e3545be2-21fc-4b40-8991-8f251f94fbce', '402f9003-bbb5-42ac-929a-78e266fb6436', 'e917c173-3ad1-4417-99b7-759be5fb28cd', '51c7a16a-1e75-477c-a91b-005e0728e200'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:20 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:38:20 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:20 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.234s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:20 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Deleted volume successfully. Nov 06 21:38:20 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-544c6e6c-a35f-473b-b5ed-bc2840cf0325 tempest-ProjectReaderTests-1471367775 None] Lock "cinder-0d1351ae-7541-471e-9c2f-17999173dd32-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (52ceb0b4-098a-48f6-9819-4c2584dca077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45af79c-a503-4fe2-bfe4-dd54174fe5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45af79c-a503-4fe2-bfe4-dd54174fe5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851058318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ebe4c-f596-4f47-9d16-8233061d2569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:21Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b343a90-a03f-4ee7-b783-3e9e1ad5a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b343a90-a03f-4ee7-b783-3e9e1ad5a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39b1b96-61cc-49f4-b0df-d74ddea1f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39b1b96-61cc-49f4-b0df-d74ddea1f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930ebe4c-f596-4f47-9d16-8233061d2569', 'volume_name': 'volume-930ebe4c-f596-4f47-9d16-8233061d2569', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b67c5-d364-48e5-aeb4-68664903384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655b67c5-d364-48e5-aeb4-68664903384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daf36e6-163f-4dd7-863c-7894ea05723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:21 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Volume 930ebe4c-f596-4f47-9d16-8233061d2569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930ebe4c-f596-4f47-9d16-8233061d2569', 'volume_size': 1} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851058318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ebe4c-f596-4f47-9d16-8233061d2569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:21Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Creating volume 930ebe4c-f596-4f47-9d16-8233061d2569 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:21 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:21 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 1073741824 Nov 06 21:38:21 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:21 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 1073741824" returned: 0 in 0.422s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:21 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:21 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 Nov 06 21:38:21 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:22 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daf36e6-163f-4dd7-863c-7894ea05723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930ebe4c-f596-4f47-9d16-8233061d2569', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9802866a-3fa0-4533-a9d1-7818b0377b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:22 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Volume volume-930ebe4c-f596-4f47-9d16-8233061d2569 (930ebe4c-f596-4f47-9d16-8233061d2569): created successfully Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9802866a-3fa0-4533-a9d1-7818b0377b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (52ceb0b4-098a-48f6-9819-4c2584dca077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:22 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e94a5328-6f19-4068-b2ed-058ddf6f5a2e tempest-ProjectReaderTests-1471367775 None] Created volume successfully. Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-930ebe4c-f596-4f47-9d16-8233061d2569-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-930ebe4c-f596-4f47-9d16-8233061d2569-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-quobyte-930ebe4c-f596-4f47-9d16-8233061d2569" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-930ebe4c-f596-4f47-9d16-8233061d2569" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159c9b2-8543-4ec1-9a1b-47a3cd253a1c]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:22 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 Nov 06 21:38:22 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:22 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569" returned: 0 in 0.403s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:22 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:22 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569 Nov 06 21:38:22 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:23 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-930ebe4c-f596-4f47-9d16-8233061d2569" returned: 0 in 0.259s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-930ebe4c-f596-4f47-9d16-8233061d2569" released by "delete_volume" :: held 0.719s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Created reservations ['70299929-0383-4050-85f3-5f59a08a9bca', 'fa74c3f3-20f6-427f-8250-20de76c9e96c', 'cfffb2c7-a695-47e0-923f-27bd9fca5b58', 'cb32dcb9-9f22-4fbd-af01-d35a3dd25601'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:23 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:38:23 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:23 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.240s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:23 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Deleted volume successfully. Nov 06 21:38:23 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-f07ff520-3ac7-42db-9d7b-bedc4871641d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-930ebe4c-f596-4f47-9d16-8233061d2569-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87230) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (f429fd84-5c8b-4046-8618-336cde3a379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665a2bac-c9dd-45d2-8c10-6a423d926139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665a2bac-c9dd-45d2-8c10-6a423d926139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852613020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae46c7-b929-44d9-83d5-0cc8d82b5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:24Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb498fc1-affb-4af7-b997-364b478f5c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb498fc1-affb-4af7-b997-364b478f5c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf9def5-630f-4abe-bb89-1b10291f1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf9def5-630f-4abe-bb89-1b10291f1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efae46c7-b929-44d9-83d5-0cc8d82b5a23', 'volume_name': 'volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33232970-d194-4471-9a00-46b3579432e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33232970-d194-4471-9a00-46b3579432e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e705866-ce83-4d66-b6cc-489872a7fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Volume efae46c7-b929-44d9-83d5-0cc8d82b5a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23', 'volume_size': 1} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852613020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efae46c7-b929-44d9-83d5-0cc8d82b5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6435b73c734329815511f9c7953e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:24Z,use_quota=True,user_id='7693c3e5831b4f33ade33ffcf672981e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4b74b3-7446-4c10-b4a1-17049b5ffe2f),volume_type_id=ea4b74b3-7446-4c10-b4a1-17049b5ffe2f)}" {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.remotefs [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Creating volume efae46c7-b929-44d9-83d5-0cc8d82b5a23 {{(pid=87230) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Selected osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 as target Quobyte volume. {{(pid=87230) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:24 devstack cinder-volume[87230]: INFO cinder.volume.drivers.remotefs [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] casted to osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563 Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 1073741824 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:24 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 1073741824 Nov 06 21:38:24 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:24 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 1073741824" returned: 0 in 0.414s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:24 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 Nov 06 21:38:24 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:24 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23" returned: 0 in 0.246s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'} {{(pid=87230) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e705866-ce83-4d66-b6cc-489872a7fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23', 'volume_size': 1}' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dc5782-5d73-4b17-8c45-0c6c16e38d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:24 devstack cinder-volume[87230]: INFO cinder.volume.flows.manager.create_volume [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Volume volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 (efae46c7-b929-44d9-83d5-0cc8d82b5a23): created successfully Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dc5782-5d73-4b17-8c45-0c6c16e38d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87230) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:24 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Flow 'volume_create_manager' (f429fd84-5c8b-4046-8618-336cde3a379b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87230) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:24 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-e53d3b65-5440-4f90-b786-18fd8bc69ea6 tempest-ProjectReaderTests-1471367775 None] Created volume successfully. Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-efae46c7-b929-44d9-83d5-0cc8d82b5a23-delete_volume" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-efae46c7-b929-44d9-83d5-0cc8d82b5a23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "cinder-quobyte-efae46c7-b929-44d9-83d5-0cc8d82b5a23" by "delete_volume" {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-efae46c7-b929-44d9-83d5-0cc8d82b5a23" acquired by "delete_volume" :: waited 0.015s {{(pid=87230) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d6d623-0b76-4a5b-ac43-32fc735c63bf]: (4, 'qcow2') {{(pid=88898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:25 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 Nov 06 21:38:25 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:25 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23" returned: 0 in 0.377s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:25 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23 Nov 06 21:38:25 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:25 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40/volume-efae46c7-b929-44d9-83d5-0cc8d82b5a23" returned: 0 in 0.240s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-quobyte-efae46c7-b929-44d9-83d5-0cc8d82b5a23" released by "delete_volume" :: held 0.655s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.quota [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Created reservations ['f0e361f1-372a-4bfa-8825-81720e5ed8c8', 'bc65ab50-9a89-42e4-928f-ab8aa0387b7c', 'dc52be3b-8d20-40d2-9804-94474e1b6a97', '4f54c8c0-97a0-4dcb-86d9-bcb5e817ac77'] {{(pid=87230) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:25 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:25 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:38:25 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:26 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:26 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.273s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:26 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:26 devstack cinder-volume[87230]: INFO cinder.volume.manager [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Deleted volume successfully. Nov 06 21:38:26 devstack cinder-volume[87230]: DEBUG cinder.coordination [None req-0aa8b90c-59cb-4531-9b9a-903dbbc3064d tempest-ProjectReaderTests-1471367775 None] Lock "cinder-efae46c7-b929-44d9-83d5-0cc8d82b5a23-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87230) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:35 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=27,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:36 devstack cinder-volume[87230]: DEBUG dbcounter [-] [87230] Writing DB stats cinder:SELECT=29,cinder:UPDATE=47,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563': None} {{(pid=87230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.drivers.quobyte [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e9981292-2434-4333-818f-0d00a3bf9563'] {{(pid=87230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.lockutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:38 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40 Nov 06 21:38:38 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:38 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_concurrency.processutils [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d28e3208642c447a5e5feac3f54c0a40" returned: 0 in 0.255s {{(pid=87230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG cinder.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Notifying Schedulers of capabilities ... {{(pid=87230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG oslo_service.periodic_task [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] Running periodic task VolumeManager._thread_info {{(pid=87230) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread count: 29 {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:38:38 devstack cinder-volume[87230]: DEBUG cinder.volume.manager [None req-7f5f2f1f-b9bd-4954-904c-8548747fe6d6 None None] thread info: [<_MainThread(MainThread, started 128143098519680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87230) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}}